Jul 10 06:31:34 devstack cinder-volume[75999]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 06:31:34 devstack cinder-volume[75999]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 06:31:34 devstack cinder-volume[75999]: we strongly recommend against using it for new projects. Jul 10 06:31:34 devstack cinder-volume[75999]: If you are already using Eventlet, we recommend migrating to a different Jul 10 06:31:34 devstack cinder-volume[75999]: framework. For more detail see Jul 10 06:31:34 devstack cinder-volume[75999]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 06:31:34 devstack cinder-volume[75999]: import eventlet # noqa Jul 10 06:31:36 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:31:36 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:31:36 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:31:37 devstack cinder-volume[75999]: INFO dbcounter [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Registered counter for database cinder Jul 10 06:31:37 devstack cinder-volume[75999]: DEBUG oslo_db.sqlalchemy.engines [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:31:38 devstack cinder-volume[75999]: DEBUG dbcounter [-] [75999] Writer thread running {{(pid=75999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:31:38 devstack cinder-volume[75999]: INFO cinder.rpc [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 06:31:38 devstack cinder-volume[75999]: INFO cinder.rpc [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 06:31:38 devstack cinder-volume[75999]: DEBUG oslo_db.sqlalchemy.engines [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:31:38 devstack cinder-volume[75999]: INFO cinder.volume.manager [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Determined volume DB was empty at startup. Jul 10 06:31:38 devstack cinder-volume[75999]: DEBUG cinder.volume.manager [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75999) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 06:31:38 devstack cinder-volume[75999]: INFO cinder.volume.manager [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 06:31:38 devstack cinder-volume[75999]: WARNING stevedore.named [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 06:31:38 devstack cinder-volume[75999]: WARNING castellan.key_manager [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:31:38 devstack cinder-volume[75999]: WARNING cinder.keymgr.conf_key_mgr [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:31:38 devstack cinder-volume[75999]: DEBUG cinder.volume.drivers.lvm [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75999) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 06:31:38 devstack cinder-volume[75999]: DEBUG oslo_concurrency.processutils [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:38 devstack cinder-volume[75999]: DEBUG oslo_concurrency.processutils [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] CMD "cinder-rtstool verify" returned: 0 in 0.464s {{(pid=75999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:38 devstack cinder-volume[75999]: DEBUG oslo_db.sqlalchemy.engines [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:31:38 devstack cinder-volume[75999]: INFO cinder.rpc [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 06:31:38 devstack cinder-volume[75999]: INFO cinder.rpc [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 06:31:38 devstack cinder-volume[75999]: WARNING stevedore.named [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 06:31:38 devstack cinder-volume[75999]: WARNING castellan.key_manager [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:31:38 devstack cinder-volume[75999]: INFO cinder.volume.manager [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 06:31:38 devstack cinder-volume[75999]: DEBUG oslo_db.sqlalchemy.engines [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:31:38 devstack cinder-volume[75999]: INFO oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Starting 1 workers Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Started child 76159 {{(pid=75999) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Full set of CONF: {{(pid=75999) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] ******************************************************************************** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Configuration options gathered from: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] ================================================================================ {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] allow_availability_zone_fallback = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] allow_compression_on_image_upload = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] allowed_direct_url_schemes = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] api_rate_limit = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] auth_strategy = keystone {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] az_cache_duration = 3600 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_availability_zone = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_host = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_stats_polling_interval = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backup_api_class = cinder.backup.api.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backup_name_template = backup-%s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[76159]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backup_use_same_host = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backup_use_temp_snapshot = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] chap_password = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] chap_username = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cinder_internal_tenant_project_id = 82aa9f2c257b462f9d9b5b607b2ef06a {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cinder_internal_tenant_user_id = 2d08759b9c4c483ebc64e8e3dcb1f0da {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cloned_volume_same_az = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cluster = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] compression_format = gzip {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] compute_api_class = cinder.compute.nova.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] config_dir = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] config_source = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] control_exchange = openstack {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] debug = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] default_availability_zone = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] default_group_type = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] default_volume_type = lvmdriver-1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] disk_geometry = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] driver_client_cert = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] driver_client_cert_key = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] driver_data_namespace = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] driver_ssl_cert_path = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] driver_ssl_cert_verify = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] driver_use_ssl = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] enable_force_upload = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] enable_new_services = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] enable_unsupported_driver = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] enabled_backends = ['lvmdriver-1'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] enforce_multipath_for_image_xfer = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] filter_function = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance_api_insecure = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance_api_ssl_compression = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance_ca_certificates_file = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance_catalog_info = image:glance:publicURL {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance_certfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance_keyfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance_num_retries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance_request_timeout = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] goodness_function = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] graceful_shutdown_timeout = 5 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] group_api_class = cinder.group.api.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] host = devstack {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] image_compress_on_upload = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] image_conversion_address_space_limit = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] image_conversion_cpu_limit = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] image_conversion_disable = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] image_upload_use_cinder_backend = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] image_upload_use_internal_tenant = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] image_volume_cache_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] image_volume_cache_max_count = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] image_volume_cache_max_size_gb = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] init_host_max_objects_retrieval = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] instance_format = [instance: %(uuid)s] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] iscsi_target_flags = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] iscsi_write_cache = on {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] iser_helper = tgtadm {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] iser_ip_address = 192.168.122.31 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] iser_port = 3260 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] log_color = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] log_config_append = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] log_dir = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] log_file = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] log_options = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] log_rotate_interval = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] log_rotate_interval_type = days {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] log_rotation_type = none {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] max_age = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] max_logfile_count = 30 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] max_logfile_size_mb = 200 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] max_over_subscription_ratio = 20.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] message_reap_interval = 86400 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] message_ttl = 2592000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] migration_create_volume_timeout_secs = 300 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] monkey_patch = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] monkey_patch_modules = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] my_ip = 192.168.122.31 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] no_snapshot_gb_quota = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] num_iser_scan_tries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] num_shell_tries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] num_volume_device_scan_tries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] nvmeof_conn_info_version = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] nvmet_ns_id = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] nvmet_port_id = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] osapi_max_limit = 1000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] osapi_volume_ext_list = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] osapi_volume_listen = 0.0.0.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] osapi_volume_listen_port = 8776 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] osapi_volume_use_ssl = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] osapi_volume_workers = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] per_volume_size_limit = -1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] periodic_fuzzy_delay = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] periodic_interval = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] project_id_regex = [0-9a-f\-]+ {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] public_endpoint = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] publish_errors = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] quota_backup_gigabytes = 1000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] quota_backups = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] quota_gigabytes = 1000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] quota_groups = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[76159]: INFO cinder.volume.manager [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] quota_snapshots = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] quota_volumes = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] rate_limit_burst = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] rate_limit_except_level = CRITICAL {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] rate_limit_interval = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] reinit_driver_count = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] replication_device = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] report_discard_supported = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] report_interval = 120 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] reservation_clean_interval = 86400 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] reservation_expire = 86400 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] reserved_image_namespaces = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] reserved_percentage = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] rpc_response_timeout = 120 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] run_external_periodic_tasks = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] scst_target_driver = iscsi {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] scst_target_iqn_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] service_down_time = 720 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] shell_completion = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] snapshot_name_template = snapshot-%s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] snapshot_same_host = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] split_loggers = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] state_path = /opt/stack/data/cinder {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] storage_availability_zone = nova {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] storage_protocol = iSCSI {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] syslog_log_facility = LOG_USER {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] target_helper = lioadm {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] target_ip_address = 192.168.122.31 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] target_port = 3260 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] target_protocol = iscsi {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] target_secondary_ip_addresses = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] trace_flags = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] transfer_api_class = cinder.transfer.api.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] transport_url = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] until_refresh = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] use_chap_auth = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] use_default_quota_class = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] use_journal = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] use_json = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] use_multipath_for_image_xfer = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] use_stderr = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] use_syslog = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] verify_glance_signatures = enabled {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_api_class = cinder.volume.api.API {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_backend_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_clear = zero {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_clear_ionice = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_clear_size = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_copy_bps_limit = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_dd_blocksize = 1M {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_name_template = volume-%s {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_service_inithost_offload = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volume_usage_audit_period = month {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] zoning_mode = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_concurrency.disable_process_locking = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.auth_section = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.auth_type = password {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.auth_version = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.cache = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.certfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.delay_auth_decision = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.http_connect_timeout = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.include_service_catalog = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.insecure = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.interface = public {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.keyfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_password = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcache_username = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.region_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.service_token_roles_required = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.service_type = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.token_cache_time = 300 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.backend = dogpile.cache.null {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.backend_argument = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.backend_expiration_time = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.config_prefix = cache.oslo {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.debug_cache_backend = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.enable_retry_client = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.enable_socket_keepalive = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.expiration_time = 600 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.hashclient_retry_attempts = 2 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.memcache_dead_retry = 300 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.memcache_pool_maxsize = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.memcache_sasl_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.password = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.proxies = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.redis_db = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.redis_sentinel_service_name = mymaster {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.redis_server = localhost:6379 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.retry_attempts = 2 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.retry_delay = 0.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.socket_keepalive_count = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.socket_keepalive_idle = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.socket_keepalive_interval = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.socket_timeout = 1.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.tls_allowed_ciphers = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.tls_cafile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.tls_certfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.tls_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.tls_keyfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cache.username = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] coordination.backend_url = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.asyncio_connection = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.asyncio_slave_connection = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.backend = sqlalchemy {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.connection = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.connection_debug = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.connection_parameters = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.connection_recycle_time = 3600 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.connection_trace = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.db_inc_retry_interval = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.db_max_retries = 20 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.db_max_retry_interval = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.db_retry_interval = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.max_overflow = 50 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.max_pool_size = 5 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.max_retries = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.mysql_wsrep_sync_wait = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.pool_timeout = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.retry_interval = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.slave_connection = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.sqlite_synchronous = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.synchronous_reader = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] database.use_db_reconnect = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler.connection_string = messaging:// {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler.enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler.es_doc_type = notification {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler.es_scroll_size = 10000 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler.es_scroll_time = 2m {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler.filter_error_trace = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler.hmac_keys = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler.sentinel_service_name = mymaster {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler.socket_timeout = 0.1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler.trace_requests = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler.trace_sqlalchemy = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler_jaeger.process_tags = {} {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler_jaeger.service_name_prefix = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] profiler_otlp.service_name_prefix = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_policy.enforce_new_defaults = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_policy.enforce_scope = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_policy.policy_default_rule = default {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_policy.policy_file = policy.yaml {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_policy.remote_timeout = 60.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] privsep_osbrick.group = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] privsep_osbrick.helper_command = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] privsep_osbrick.user = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cinder_sys_admin.group = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cinder_sys_admin.helper_command = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] cinder_sys_admin.user = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] service_user.auth_section = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] service_user.auth_type = password {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] service_user.cafile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] service_user.certfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] service_user.collect_timing = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] service_user.insecure = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] service_user.keyfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] service_user.send_service_user_token = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] service_user.split_loggers = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] service_user.timeout = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance.auth_section = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance.auth_type = password {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance.certfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance.collect_timing = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance.insecure = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance.keyfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance.region_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance.split_loggers = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] glance.timeout = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.backend_availability_zone = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.chap_password = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.chap_username = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.disk_geometry = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.driver_client_cert = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.driver_client_cert_key = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.driver_data_namespace = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.driver_use_ssl = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.enable_unsupported_driver = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.extra_capabilities = {} {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.filter_function = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.goodness_function = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.iscsi_target_flags = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.iscsi_write_cache = on {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.iser_helper = tgtadm {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.iser_port = 3260 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.lvm_mirrors = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.lvm_share_target = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.lvm_type = auto {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.num_shell_tries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.nvmet_port_id = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.replication_device = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.report_discard_supported = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.reserved_percentage = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.scst_target_driver = iscsi {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.scst_target_iqn_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.storage_protocol = iSCSI {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.target_helper = tgtadm {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.target_port = 3260 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.target_protocol = iscsi {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.trace_flags = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.unique_fqdn_network = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.use_chap_auth = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.volume_backend_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.volume_clear = zero {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.volume_clear_ionice = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.volume_clear_size = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.volume_group = cinder-volumes {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_reports.file_event_handler = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_reports.log_dir = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.backend_availability_zone = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.backend_host = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.chap_password = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.chap_username = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.chiscsi_conf = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.disk_geometry = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.driver_client_cert = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.driver_data_namespace = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.driver_use_ssl = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.extra_capabilities = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.filter_function = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.goodness_function = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.iser_helper = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.iser_ip_address = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.iser_port = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.iser_target_prefix = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.lvm_conf_file = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.lvm_mirrors = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.lvm_share_target = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.lvm_type = auto {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.num_shell_tries = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.nvmet_port_id = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.replication_device = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.report_discard_supported = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.reserved_percentage = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.scst_target_driver = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.storage_protocol = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.target_helper = lioadm {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.target_ip_address = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.target_port = 3260 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.target_protocol = iscsi {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.trace_flags = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.use_chap_auth = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.volume_clear = zero {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.volume_clear_size = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] lvmdriver-1.volumes_dir = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.ssl = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.ssl_version = {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_notifications.driver = [] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_notifications.retry = -1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] oslo_messaging_notifications.transport_url = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack sudo[76164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 06:31:39 devstack sudo[76164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] key_manager.fixed_key = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.barbican_api_version = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.barbican_endpoint = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.barbican_endpoint_type = public {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.barbican_region_name = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.cafile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.certfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.collect_timing = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.insecure = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.keyfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.number_of_retries = 60 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.retry_delay = 1 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.send_service_user_token = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.split_loggers = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.timeout = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.verify_ssl = True {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican.verify_ssl_path = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican_service_user.auth_section = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican_service_user.auth_type = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican_service_user.cafile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican_service_user.certfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican_service_user.collect_timing = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican_service_user.insecure = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican_service_user.keyfile = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican_service_user.split_loggers = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] barbican_service_user.timeout = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vault.approle_role_id = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vault.approle_secret_id = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vault.kv_mountpoint = secret {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vault.kv_path = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vault.kv_version = 2 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vault.namespace = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vault.root_token_id = **** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vault.ssl_ca_crt_file = None {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vault.timeout = 60.0 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vault.use_ssl = False {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:31:39 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] ******************************************************************************** {{(pid=75999) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 06:31:39 devstack sudo[76164]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:39 devstack sudo[76402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:31:39 devstack sudo[76402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:40 devstack sudo[76402]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:40 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.626s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:40 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:31:40 devstack cinder-volume[76159]: INFO cinder.brick.local_dev.lvm [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 06:31:40 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:40 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:40 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:40 devstack sudo[76606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:31:40 devstack sudo[76606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:41 devstack sudo[76606]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:41 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.777s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:41 devstack cinder-volume[76159]: DEBUG cinder.brick.local_dev.lvm [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76159) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 06:31:41 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:41 devstack sudo[76757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:31:41 devstack sudo[76757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:42 devstack sudo[76757]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:42 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.121s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:42 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:42 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:42 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:42 devstack sudo[76936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:31:42 devstack sudo[76936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:43 devstack sudo[76936]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:43 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.670s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:43 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:43 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:43 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:43 devstack sudo[76942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 06:31:43 devstack sudo[76942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:43 devstack sudo[76942]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:43 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.671s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:43 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:43 devstack sudo[76947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:31:43 devstack sudo[76947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:44 devstack sudo[76947]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:44 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.719s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:44 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:44 devstack sudo[76951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:31:44 devstack sudo[76951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:45 devstack sudo[76951]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:45 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:45 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:45 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:31:45 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:46 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:46 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.764s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:46 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:46 devstack sudo[76968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:31:46 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:46 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:46 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.737s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:46 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:46 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:46 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:46 devstack sudo[76976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:31:46 devstack sudo[76976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:47 devstack sudo[76976]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:47 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.688s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:47 devstack cinder-volume[76159]: INFO cinder.volume.drivers.lvm [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 06:31:47 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:47 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:47 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:47 devstack sudo[76985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:31:47 devstack sudo[76985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:48 devstack sudo[76985]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:48 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.748s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:48 devstack cinder-volume[76159]: DEBUG cinder.volume.drivers.lvm [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Updating volume stats {{(pid=76159) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:31:48 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:48 devstack sudo[77099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:31:48 devstack sudo[77099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:48 devstack sudo[77099]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:48 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:48 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:48 devstack sudo[77167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:31:48 devstack sudo[77167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:48 devstack cinder-volume[75999]: DEBUG dbcounter [-] [75999] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:31:49 devstack sudo[77167]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:49 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:49 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:49 devstack sudo[77247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:31:49 devstack sudo[77247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:50 devstack sudo[77247]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:50 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.671s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:50 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:50 devstack sudo[77250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:31:50 devstack sudo[77250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:50 devstack sudo[77250]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:50 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:50 devstack cinder-volume[76159]: INFO cinder.volume.driver [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 06:31:50 devstack cinder-volume[76159]: DEBUG cinder.volume.driver [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76159) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 06:31:50 devstack cinder-volume[76159]: DEBUG oslo_db.sqlalchemy.engines [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76159) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:31:50 devstack cinder-volume[76159]: DEBUG dbcounter [-] [76159] Writer thread running {{(pid=76159) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:31:50 devstack cinder-volume[76159]: DEBUG cinder.db.api [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Building query based on filter {{(pid=76159) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 06:31:50 devstack cinder-volume[76159]: DEBUG cinder.image.image_utils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76159) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 06:31:50 devstack cinder-volume[76159]: INFO cinder.keymgr.migration [None req-a045b216-fc20-4e51-ac32-ef907b491811 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 06:31:50 devstack cinder-volume[76159]: DEBUG cinder.volume.drivers.lvm [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Updating volume stats {{(pid=76159) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:31:50 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:51 devstack sudo[77260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:31:51 devstack sudo[77260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:51 devstack sudo[77260]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:51 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:51 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:51 devstack sudo[77265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:31:51 devstack sudo[77265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:52 devstack sudo[77265]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:52 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:52 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:52 devstack sudo[77271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:31:52 devstack sudo[77271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:52 devstack sudo[77271]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:52 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:52 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:52 devstack sudo[77274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:31:52 devstack sudo[77274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:53 devstack sudo[77274]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:53 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:53 devstack cinder-volume[76159]: DEBUG cinder.manager [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Notifying Schedulers of capabilities ... {{(pid=76159) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:31:53 devstack cinder-volume[76159]: INFO cinder.volume.manager [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Driver initialization completed successfully. Jul 10 06:31:53 devstack cinder-volume[76159]: INFO cinder.manager [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Initiating service 2 cleanup Jul 10 06:31:53 devstack cinder-volume[76159]: INFO cinder.manager [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Service 2 cleanup completed. Jul 10 06:31:53 devstack cinder-volume[76159]: DEBUG cinder.service [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Creating RPC server for service cinder-volume {{(pid=76159) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 06:31:53 devstack cinder-volume[76159]: DEBUG cinder.service [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76159) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 06:31:53 devstack cinder-volume[76159]: INFO cinder.volume.manager [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 06:31:53 devstack cinder-volume[76159]: DEBUG cinder.volume.drivers.lvm [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Updating volume stats {{(pid=76159) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:31:53 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:53 devstack sudo[77279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:31:53 devstack sudo[77279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:54 devstack sudo[77279]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:54 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:54 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:54 devstack sudo[77284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:31:54 devstack sudo[77284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:55 devstack sudo[77284]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:55 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.737s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:55 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:55 devstack sudo[77287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:31:55 devstack sudo[77287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:55 devstack sudo[77287]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:55 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:55 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:55 devstack sudo[77347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:31:55 devstack sudo[77347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:56 devstack sudo[77347]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:56 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:56 devstack cinder-volume[76159]: INFO cinder.volume.manager [None req-37e476f1-6142-426e-a460-ce9bae4e6243 None None] Driver post RPC initialization completed successfully. Jul 10 06:32:03 devstack cinder-volume[76159]: DEBUG dbcounter [-] [76159] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76159) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:32:06 devstack cinder-volume[76159]: DEBUG dbcounter [-] [76159] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76159) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:32:37 devstack cinder-volume[76159]: DEBUG oslo_service.periodic_task [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76159) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:32:37 devstack cinder-volume[76159]: DEBUG cinder.volume.drivers.lvm [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Updating volume stats {{(pid=76159) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:32:37 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:32:37 devstack sudo[78742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:32:37 devstack sudo[78742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:32:38 devstack sudo[78742]: pam_unix(sudo:session): session closed for user root Jul 10 06:32:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:32:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:32:38 devstack sudo[78746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:32:38 devstack sudo[78746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:32:38 devstack sudo[78746]: pam_unix(sudo:session): session closed for user root Jul 10 06:32:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:32:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:32:38 devstack sudo[78889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:32:38 devstack sudo[78889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:32:39 devstack sudo[78889]: pam_unix(sudo:session): session closed for user root Jul 10 06:32:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.668s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:32:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:32:39 devstack sudo[78892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:32:39 devstack sudo[78892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:32:40 devstack sudo[78892]: pam_unix(sudo:session): session closed for user root Jul 10 06:32:40 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:32:40 devstack cinder-volume[76159]: DEBUG cinder.manager [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Notifying Schedulers of capabilities ... {{(pid=76159) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:32:40 devstack cinder-volume[76159]: DEBUG oslo_service.periodic_task [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running periodic task VolumeManager._thread_info {{(pid=76159) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:32:40 devstack cinder-volume[76159]: DEBUG cinder.volume.manager [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] thread count: 6 {{(pid=76159) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:32:40 devstack cinder-volume[76159]: DEBUG cinder.volume.manager [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] thread info: [<_MainThread(MainThread, started 138225795850368)>, , , , , ] {{(pid=76159) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:34:06 devstack cinder-volume[76159]: DEBUG dbcounter [-] [76159] Writing DB stats cinder:SELECT=1 {{(pid=76159) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:34:06 devstack cinder-volume[76159]: DEBUG dbcounter [-] [76159] Writing DB stats cinder:UPDATE=1 {{(pid=76159) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:34:37 devstack cinder-volume[76159]: DEBUG oslo_service.periodic_task [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76159) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:34:37 devstack cinder-volume[76159]: DEBUG cinder.volume.drivers.lvm [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Updating volume stats {{(pid=76159) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:34:37 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:34:37 devstack sudo[84006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:34:37 devstack sudo[84006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:34:38 devstack sudo[84006]: pam_unix(sudo:session): session closed for user root Jul 10 06:34:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:34:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:34:38 devstack sudo[84011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:34:38 devstack sudo[84011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:34:38 devstack sudo[84011]: pam_unix(sudo:session): session closed for user root Jul 10 06:34:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:34:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:34:38 devstack sudo[84037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:34:38 devstack sudo[84037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:34:39 devstack sudo[84037]: pam_unix(sudo:session): session closed for user root Jul 10 06:34:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:34:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:34:39 devstack sudo[84057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:34:39 devstack sudo[84057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:34:40 devstack sudo[84057]: pam_unix(sudo:session): session closed for user root Jul 10 06:34:40 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:34:40 devstack cinder-volume[76159]: DEBUG cinder.manager [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Notifying Schedulers of capabilities ... {{(pid=76159) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:34:40 devstack cinder-volume[76159]: DEBUG oslo_service.periodic_task [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running periodic task VolumeManager._thread_info {{(pid=76159) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:34:40 devstack cinder-volume[76159]: DEBUG cinder.volume.manager [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] thread count: 6 {{(pid=76159) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:34:40 devstack cinder-volume[76159]: DEBUG cinder.volume.manager [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] thread info: [<_MainThread(MainThread, started 138225795850368)>, , , , , ] {{(pid=76159) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:35:37 devstack cinder-volume[76159]: DEBUG oslo_service.periodic_task [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76159) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:35:37 devstack cinder-volume[76159]: DEBUG cinder.volume.drivers.lvm [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Updating volume stats {{(pid=76159) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:35:37 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:37 devstack sudo[85289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:35:37 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:38 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:38 devstack sudo[85295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:35:38 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:38 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:38 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:38 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:35:38 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:39 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:39 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:39 devstack sudo[85313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:35:39 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:40 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:40 devstack cinder-volume[76159]: DEBUG oslo_concurrency.processutils [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=76159) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:40 devstack cinder-volume[76159]: DEBUG cinder.manager [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Notifying Schedulers of capabilities ... {{(pid=76159) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:35:40 devstack cinder-volume[76159]: DEBUG oslo_service.periodic_task [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] Running periodic task VolumeManager._thread_info {{(pid=76159) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:35:40 devstack cinder-volume[76159]: DEBUG cinder.volume.manager [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] thread count: 6 {{(pid=76159) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:35:40 devstack cinder-volume[76159]: DEBUG cinder.volume.manager [None req-59df9c9c-447e-4c23-8756-6274d52de8c0 None None] thread info: [<_MainThread(MainThread, started 138225795850368)>, , , , , ] {{(pid=76159) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:36:06 devstack cinder-volume[76159]: DEBUG dbcounter [-] [76159] Writing DB stats cinder:SELECT=1 {{(pid=76159) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:36:06 devstack cinder-volume[76159]: DEBUG dbcounter [-] [76159] Writing DB stats cinder:UPDATE=1 {{(pid=76159) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:36:22 devstack cinder-volume[75999]: INFO oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Caught SIGTERM, stopping children Jul 10 06:36:22 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Acquiring lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:36:22 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Acquired lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:36:22 devstack cinder-volume[75999]: DEBUG oslo_concurrency.lockutils [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Releasing lock "singleton_lock" {{(pid=75999) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:36:22 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Stop services. {{(pid=75999) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 06:36:22 devstack cinder-volume[75999]: DEBUG oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Killing children. {{(pid=75999) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 06:36:22 devstack cinder-volume[75999]: INFO oslo_service.backend._eventlet.service [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Waiting on 1 children to exit Jul 10 06:36:27 devstack cinder-volume[76159]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 10 06:36:28 devstack cinder-volume[86245]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 06:36:28 devstack cinder-volume[86245]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 06:36:28 devstack cinder-volume[86245]: we strongly recommend against using it for new projects. Jul 10 06:36:28 devstack cinder-volume[86245]: If you are already using Eventlet, we recommend migrating to a different Jul 10 06:36:28 devstack cinder-volume[86245]: framework. For more detail see Jul 10 06:36:28 devstack cinder-volume[86245]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 06:36:28 devstack cinder-volume[86245]: import eventlet # noqa Jul 10 06:36:28 devstack cinder-volume[76159]: DEBUG oslo_concurrency.lockutils [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Acquiring lock "singleton_lock" {{(pid=76159) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:36:28 devstack cinder-volume[76159]: DEBUG oslo_concurrency.lockutils [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Acquired lock "singleton_lock" {{(pid=76159) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:36:28 devstack cinder-volume[76159]: DEBUG oslo_concurrency.lockutils [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Releasing lock "singleton_lock" {{(pid=76159) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:36:28 devstack cinder-volume[76159]: WARNING amqp [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 06:36:28 devstack cinder-volume[76159]: WARNING amqp [None req-084a163e-1944-4139-a95b-50f2f93dbefd None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 06:36:30 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:36:30 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:36:30 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:36:31 devstack cinder-volume[86245]: INFO dbcounter [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Registered counter for database cinder Jul 10 06:36:31 devstack cinder-volume[86245]: DEBUG oslo_db.sqlalchemy.engines [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:36:31 devstack cinder-volume[86245]: DEBUG dbcounter [-] [86245] Writer thread running {{(pid=86245) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:36:31 devstack cinder-volume[86245]: INFO cinder.rpc [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 06:36:31 devstack cinder-volume[86245]: INFO cinder.rpc [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 06:36:31 devstack cinder-volume[86245]: DEBUG oslo_db.sqlalchemy.engines [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:36:31 devstack cinder-volume[86245]: INFO cinder.volume.manager [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Determined volume DB was empty at startup. Jul 10 06:36:31 devstack cinder-volume[86245]: DEBUG cinder.volume.manager [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86245) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 06:36:31 devstack cinder-volume[86245]: INFO cinder.volume.manager [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 06:36:31 devstack cinder-volume[86245]: WARNING stevedore.named [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 06:36:31 devstack cinder-volume[86245]: WARNING castellan.key_manager [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:36:31 devstack cinder-volume[86245]: WARNING cinder.keymgr.conf_key_mgr [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:36:32 devstack cinder-volume[86245]: INFO cinder.volume.manager [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_db.sqlalchemy.engines [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:36:32 devstack cinder-volume[86245]: INFO oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Starting 1 workers Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Started child 86501 {{(pid=86245) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Full set of CONF: {{(pid=86245) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] ******************************************************************************** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Configuration options gathered from: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] ================================================================================ {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 06:36:32 devstack cinder-volume[86501]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] allow_availability_zone_fallback = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] allow_compression_on_image_upload = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] allowed_direct_url_schemes = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] api_rate_limit = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] auth_strategy = keystone {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_availability_zone = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_host = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_stats_polling_interval = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backup_api_class = cinder.backup.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backup_name_template = backup-%s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backup_use_same_host = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backup_use_temp_snapshot = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] chap_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] chap_username = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cinder_internal_tenant_project_id = 82aa9f2c257b462f9d9b5b607b2ef06a {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cinder_internal_tenant_user_id = 2d08759b9c4c483ebc64e8e3dcb1f0da {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cluster = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] compression_format = gzip {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] compute_api_class = cinder.compute.nova.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] config_dir = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] config_source = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] control_exchange = openstack {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] debug = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] default_availability_zone = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] default_group_type = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] default_volume_type = QuobyteHD {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] disk_geometry = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] driver_client_cert = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] driver_client_cert_key = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] driver_data_namespace = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] driver_ssl_cert_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] driver_ssl_cert_verify = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] driver_use_ssl = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] enable_new_services = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] enable_unsupported_driver = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] enabled_backends = ['QuobyteHD'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] enforce_multipath_for_image_xfer = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] filter_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance_api_insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance_api_ssl_compression = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance_ca_certificates_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance_catalog_info = image:glance:publicURL {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance_certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance_keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance_num_retries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance_request_timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] goodness_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] graceful_shutdown_timeout = 5 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] group_api_class = cinder.group.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] host = devstack {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] image_compress_on_upload = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] image_conversion_address_space_limit = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] image_conversion_cpu_limit = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] image_conversion_disable = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] image_upload_use_cinder_backend = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] image_upload_use_internal_tenant = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] image_volume_cache_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] image_volume_cache_max_count = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86501]: INFO cinder.volume.manager [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 06:36:32 devstack cinder-volume[86501]: DEBUG cinder.volume.drivers.remotefs [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86501) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] image_volume_cache_max_size_gb = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] init_host_max_objects_retrieval = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] instance_format = [instance: %(uuid)s] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] iscsi_target_flags = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] iscsi_write_cache = on {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] iser_helper = tgtadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] iser_ip_address = 192.168.122.31 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] iser_port = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] log_color = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] log_config_append = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] log_dir = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] log_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] log_options = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] log_rotate_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] log_rotate_interval_type = days {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] log_rotation_type = none {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] max_age = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] max_logfile_count = 30 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] max_logfile_size_mb = 200 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] max_over_subscription_ratio = 20.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] message_reap_interval = 86400 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] message_ttl = 2592000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] migration_create_volume_timeout_secs = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] monkey_patch = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] monkey_patch_modules = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] my_ip = 192.168.122.31 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] no_snapshot_gb_quota = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] num_iser_scan_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] num_shell_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] num_volume_device_scan_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] nvmeof_conn_info_version = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] nvmet_ns_id = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] nvmet_port_id = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] osapi_max_limit = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] osapi_volume_ext_list = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] osapi_volume_listen_port = 8776 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] osapi_volume_use_ssl = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] osapi_volume_workers = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] per_volume_size_limit = -1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] periodic_fuzzy_delay = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] periodic_interval = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] public_endpoint = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] publish_errors = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] quota_backup_gigabytes = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] quota_backups = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] quota_gigabytes = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] quota_groups = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] quota_snapshots = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] quota_volumes = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] rate_limit_burst = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] rate_limit_except_level = CRITICAL {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] rate_limit_interval = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] reinit_driver_count = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] replication_device = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] report_discard_supported = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] report_interval = 120 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] reservation_clean_interval = 86400 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] reservation_expire = 86400 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] reserved_image_namespaces = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] reserved_percentage = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] rpc_response_timeout = 120 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] run_external_periodic_tasks = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] scst_target_driver = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] scst_target_iqn_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] service_down_time = 720 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] shell_completion = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] snapshot_name_template = snapshot-%s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] split_loggers = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] state_path = /opt/stack/data/cinder {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] storage_availability_zone = nova {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] storage_protocol = iSCSI {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] syslog_log_facility = LOG_USER {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] target_helper = lioadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] target_ip_address = 192.168.122.31 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] target_port = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] target_protocol = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] target_secondary_ip_addresses = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] trace_flags = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] transport_url = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] until_refresh = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] use_chap_auth = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] use_default_quota_class = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] use_journal = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] use_json = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] use_multipath_for_image_xfer = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] use_stderr = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] use_syslog = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] verify_glance_signatures = enabled {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_api_class = cinder.volume.api.API {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_backend_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_clear = zero {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_clear_ionice = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_clear_size = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_copy_bps_limit = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_dd_blocksize = 1M {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_name_template = volume-%s {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_service_inithost_offload = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volume_usage_audit_period = month {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] zoning_mode = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_concurrency.disable_process_locking = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.auth_section = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.auth_type = password {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.auth_version = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.cache = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86501]: DEBUG cinder.volume.drivers.quobyte [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86501) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 06:36:32 devstack cinder-volume[86501]: WARNING cinder.volume.drivers.quobyte [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 06:36:32 devstack cinder-volume[86501]: WARNING cinder.volume.drivers.quobyte [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.include_service_catalog = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.interface = public {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86501]: DEBUG oslo_concurrency.processutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Running cmd (subprocess): mount.quobyte {{(pid=86501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_password = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcache_username = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.region_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.service_type = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.backend = dogpile.cache.null {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.backend_argument = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.backend_expiration_time = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.config_prefix = cache.oslo {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.debug_cache_backend = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.enable_retry_client = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.enable_socket_keepalive = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.expiration_time = 600 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.hashclient_retry_attempts = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.memcache_dead_retry = 300 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.memcache_pool_maxsize = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.memcache_sasl_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.proxies = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.redis_db = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.redis_server = localhost:6379 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.retry_attempts = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.retry_delay = 0.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.socket_keepalive_count = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.socket_keepalive_idle = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.socket_keepalive_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.socket_timeout = 1.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.tls_allowed_ciphers = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.tls_cafile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.tls_certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.tls_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.tls_keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cache.username = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] coordination.backend_url = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.asyncio_connection = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.asyncio_slave_connection = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.backend = sqlalchemy {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.connection = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.connection_debug = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.connection_parameters = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.connection_recycle_time = 3600 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.connection_trace = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.db_inc_retry_interval = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.db_max_retries = 20 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.db_max_retry_interval = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.db_retry_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.max_overflow = 50 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.max_pool_size = 5 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.max_retries = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.mysql_wsrep_sync_wait = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.pool_timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.retry_interval = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.slave_connection = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.sqlite_synchronous = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.synchronous_reader = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] database.use_db_reconnect = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler.connection_string = messaging:// {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler.enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler.es_doc_type = notification {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler.es_scroll_size = 10000 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler.es_scroll_time = 2m {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler.filter_error_trace = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler.hmac_keys = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler.sentinel_service_name = mymaster {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler.socket_timeout = 0.1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler.trace_requests = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler.trace_sqlalchemy = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler_jaeger.process_tags = {} {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler_jaeger.service_name_prefix = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] profiler_otlp.service_name_prefix = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_policy.enforce_new_defaults = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_policy.enforce_scope = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_policy.policy_default_rule = default {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_policy.policy_file = policy.yaml {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] privsep_osbrick.group = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] privsep_osbrick.helper_command = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] privsep_osbrick.user = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cinder_sys_admin.group = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cinder_sys_admin.helper_command = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] cinder_sys_admin.user = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] service_user.auth_section = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] service_user.auth_type = password {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] service_user.cafile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] service_user.certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] service_user.collect_timing = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] service_user.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] service_user.keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] service_user.send_service_user_token = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] service_user.split_loggers = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] service_user.timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance.auth_section = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack quobyte-client[86511]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance.auth_type = password {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance.certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance.collect_timing = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance.keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance.region_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack quobyte-client[86511]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance.split_loggers = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] glance.timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86501]: DEBUG oslo_concurrency.processutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] CMD "mount.quobyte" returned: 1 in 0.103s {{(pid=86501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:32 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:32 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:32 devstack cinder-volume[86501]: DEBUG cinder.volume.drivers.quobyte [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86501) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.backend_availability_zone = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86501]: INFO cinder.volume.drivers.quobyte [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 ... Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.chap_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86501]: DEBUG oslo_concurrency.processutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 -c /etc/quobyte/client-cinder.cfg {{(pid=86501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.chap_username = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.disk_geometry = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.driver_client_cert = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.driver_client_cert_key = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.driver_data_namespace = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.driver_use_ssl = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.extra_capabilities = {} {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.filter_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.goodness_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.iscsi_target_flags = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.iscsi_write_cache = on {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.iser_helper = tgtadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.iser_port = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nas_host = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nas_login = admin {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nas_mount_options = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nas_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nas_private_key = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nas_share_path = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.num_shell_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 -c /etc/quobyte/client-cinder.cfg Jul 10 06:36:32 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.quobyte_volume_url = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.replication_device = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.report_discard_supported = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.reserved_percentage = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.target_helper = tgtadm {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.target_port = 3260 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.target_protocol = iscsi {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.trace_flags = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.unique_fqdn_network = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.use_chap_auth = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.volume_backend_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.volume_clear = zero {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.volume_clear_ionice = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.volume_clear_size = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_reports.file_event_handler = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_reports.log_dir = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.backend_availability_zone = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.backend_host = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.chap_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.chap_username = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.chiscsi_conf = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.disk_geometry = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.driver_client_cert = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.driver_data_namespace = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.driver_use_ssl = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.extra_capabilities = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.filter_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.goodness_function = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.iser_helper = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.iser_ip_address = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.iser_port = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.iser_target_prefix = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nas_host = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nas_login = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nas_mount_options = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nas_password = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nas_private_key = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nas_share_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nas_ssh_port = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.num_shell_tries = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.nvmet_port_id = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.replication_device = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.report_discard_supported = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.reserved_percentage = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.scst_target_driver = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.storage_protocol = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.target_helper = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.target_ip_address = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.target_port = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.target_prefix = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.target_protocol = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.trace_flags = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.use_chap_auth = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.volume_clear = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.volume_clear_size = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] QuobyteHD.volumes_dir = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.ssl = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_notifications.driver = [] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_notifications.retry = -1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] key_manager.fixed_key = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.barbican_api_version = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.barbican_endpoint = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.barbican_endpoint_type = public {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.barbican_region_name = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.cafile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.collect_timing = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.number_of_retries = 60 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.retry_delay = 1 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.send_service_user_token = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.split_loggers = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.verify_ssl = True {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican.verify_ssl_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican_service_user.auth_section = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican_service_user.auth_type = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican_service_user.cafile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican_service_user.certfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican_service_user.collect_timing = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican_service_user.insecure = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican_service_user.keyfile = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican_service_user.split_loggers = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] barbican_service_user.timeout = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vault.approle_role_id = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vault.approle_secret_id = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vault.kv_mountpoint = secret {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vault.kv_path = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vault.kv_version = 2 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vault.namespace = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vault.root_token_id = **** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vault.ssl_ca_crt_file = None {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vault.timeout = 60.0 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vault.use_ssl = False {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:32 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] ******************************************************************************** {{(pid=86245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 06:36:33 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:33 devstack cinder-volume[86501]: DEBUG oslo_concurrency.processutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.956s {{(pid=86501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:33 devstack cinder-volume[86501]: INFO cinder.volume.drivers.quobyte [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 succeeded Jul 10 06:36:33 devstack cinder-volume[86501]: DEBUG cinder.volume.drivers.quobyte [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86501) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:36:33 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.970s {{(pid=86501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:33 devstack cinder-volume[86501]: DEBUG oslo_concurrency.processutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:33 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:36:33 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:34 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG oslo_concurrency.processutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.780s {{(pid=86501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:34 devstack cinder-volume[86501]: INFO cinder.volume.driver [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG cinder.volume.driver [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540664672852, 'free_capacity_gb': 1775.7540664672852, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86501) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG oslo_db.sqlalchemy.engines [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86501) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG dbcounter [-] [86501] Writer thread running {{(pid=86501) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG cinder.db.api [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Building query based on filter {{(pid=86501) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG cinder.image.image_utils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86501) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 06:36:34 devstack cinder-volume[86501]: INFO cinder.keymgr.migration [None req-8b355af3-cdd6-41cd-a7a1-445faa96266a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG cinder.volume.drivers.quobyte [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86501) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG cinder.volume.drivers.quobyte [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86501) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:34 devstack cinder-volume[86501]: DEBUG oslo_concurrency.processutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:34 devstack sudo[86653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:36:34 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:35 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:35 devstack cinder-volume[86501]: DEBUG oslo_concurrency.processutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.137s {{(pid=86501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:35 devstack cinder-volume[86501]: DEBUG cinder.manager [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Notifying Schedulers of capabilities ... {{(pid=86501) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:36:35 devstack cinder-volume[86501]: INFO cinder.volume.manager [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Driver initialization completed successfully. Jul 10 06:36:35 devstack cinder-volume[86501]: INFO cinder.manager [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Initiating service 3 cleanup Jul 10 06:36:35 devstack cinder-volume[86501]: INFO cinder.manager [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Service 3 cleanup completed. Jul 10 06:36:35 devstack cinder-volume[86501]: DEBUG cinder.service [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Creating RPC server for service cinder-volume {{(pid=86501) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 06:36:35 devstack cinder-volume[86501]: DEBUG cinder.service [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86501) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 06:36:35 devstack cinder-volume[86501]: INFO cinder.volume.manager [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 06:36:35 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:35 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:35 devstack cinder-volume[86501]: DEBUG cinder.volume.drivers.quobyte [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86501) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:36:35 devstack cinder-volume[86501]: DEBUG cinder.volume.drivers.quobyte [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86501) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:36:35 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86501) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:35 devstack cinder-volume[86501]: DEBUG oslo_concurrency.processutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:36 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:36:36 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:36 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:36 devstack cinder-volume[86501]: DEBUG oslo_concurrency.processutils [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.900s {{(pid=86501) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:36 devstack cinder-volume[86501]: INFO cinder.volume.manager [None req-8a783cb7-45fe-403a-9677-3a15a81160f6 None None] Driver post RPC initialization completed successfully. Jul 10 06:36:37 devstack cinder-volume[86245]: INFO oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Caught SIGTERM, stopping children Jul 10 06:36:37 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Acquiring lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:36:37 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Acquired lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:36:37 devstack cinder-volume[86245]: DEBUG oslo_concurrency.lockutils [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Releasing lock "singleton_lock" {{(pid=86245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:36:37 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Stop services. {{(pid=86245) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 06:36:37 devstack cinder-volume[86245]: DEBUG oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Killing children. {{(pid=86245) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 06:36:37 devstack cinder-volume[86245]: INFO oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Waiting on 1 children to exit Jul 10 06:36:38 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Acquiring lock "singleton_lock" {{(pid=86501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:36:38 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Acquired lock "singleton_lock" {{(pid=86501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:36:38 devstack cinder-volume[86501]: DEBUG oslo_concurrency.lockutils [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Releasing lock "singleton_lock" {{(pid=86501) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:36:38 devstack cinder-volume[86501]: WARNING amqp [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 06:36:38 devstack cinder-volume[86501]: WARNING amqp [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 06:36:38 devstack cinder-volume[86245]: INFO oslo_service.backend._eventlet.service [None req-365b8d71-a881-448d-b22d-565edfb65a5d None None] Child 86501 exited with status 0 Jul 10 06:36:38 devstack cinder-volume[86885]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 06:36:38 devstack cinder-volume[86885]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 06:36:38 devstack cinder-volume[86885]: we strongly recommend against using it for new projects. Jul 10 06:36:38 devstack cinder-volume[86885]: If you are already using Eventlet, we recommend migrating to a different Jul 10 06:36:38 devstack cinder-volume[86885]: framework. For more detail see Jul 10 06:36:38 devstack cinder-volume[86885]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 06:36:38 devstack cinder-volume[86885]: import eventlet # noqa Jul 10 06:36:40 devstack cinder-volume[86885]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86885) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:36:40 devstack cinder-volume[86885]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86885) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:36:40 devstack cinder-volume[86885]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86885) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:36:41 devstack cinder-volume[86885]: INFO dbcounter [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Registered counter for database cinder Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_db.sqlalchemy.engines [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86885) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG dbcounter [-] [86885] Writer thread running {{(pid=86885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:36:41 devstack cinder-volume[86885]: INFO cinder.rpc [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 06:36:41 devstack cinder-volume[86885]: INFO cinder.rpc [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_db.sqlalchemy.engines [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86885) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:36:41 devstack cinder-volume[86885]: INFO cinder.volume.manager [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Determined volume DB was empty at startup. Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG cinder.volume.manager [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86885) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 06:36:41 devstack cinder-volume[86885]: WARNING stevedore.named [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 06:36:41 devstack cinder-volume[86885]: WARNING castellan.key_manager [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:36:41 devstack cinder-volume[86885]: WARNING cinder.keymgr.conf_key_mgr [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:36:41 devstack cinder-volume[86885]: INFO cinder.volume.manager [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_db.sqlalchemy.engines [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86885) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:36:41 devstack cinder-volume[86885]: INFO oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Starting 1 workers Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Started child 86966 {{(pid=86885) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Full set of CONF: {{(pid=86885) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] ******************************************************************************** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] Configuration options gathered from: {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] ================================================================================ {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] allow_availability_zone_fallback = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] allow_compression_on_image_upload = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] allowed_direct_url_schemes = [] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] api_rate_limit = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] auth_strategy = keystone {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_availability_zone = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86966]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_host = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_name = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_stats_polling_interval = 60 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backup_api_class = cinder.backup.api.API {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backup_name_template = backup-%s {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backup_use_same_host = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backup_use_temp_snapshot = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] chap_password = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] chap_username = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cinder_internal_tenant_project_id = 82aa9f2c257b462f9d9b5b607b2ef06a {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cinder_internal_tenant_user_id = 2d08759b9c4c483ebc64e8e3dcb1f0da {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cluster = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] compression_format = gzip {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] compute_api_class = cinder.compute.nova.API {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] config_dir = [] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] config_source = [] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] control_exchange = openstack {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] debug = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] default_availability_zone = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] default_group_type = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] default_volume_type = QuobyteHD {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] disk_geometry = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] driver_client_cert = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] driver_client_cert_key = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] driver_data_namespace = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] driver_ssl_cert_path = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] driver_ssl_cert_verify = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] driver_use_ssl = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] enable_new_services = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] enable_unsupported_driver = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] enabled_backends = ['QuobyteHD'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] enforce_multipath_for_image_xfer = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] filter_function = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance_api_insecure = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance_api_servers = ['http://192.168.122.31/image'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance_api_ssl_compression = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance_ca_certificates_file = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance_catalog_info = image:glance:publicURL {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance_certfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance_keyfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance_num_retries = 3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance_request_timeout = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] goodness_function = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] graceful_shutdown_timeout = 5 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] group_api_class = cinder.group.api.API {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] host = devstack {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] image_compress_on_upload = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] image_conversion_address_space_limit = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] image_conversion_cpu_limit = 60 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] image_conversion_disable = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] image_upload_use_cinder_backend = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] image_upload_use_internal_tenant = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] image_volume_cache_enabled = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] image_volume_cache_max_count = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] image_volume_cache_max_size_gb = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] init_host_max_objects_retrieval = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] instance_format = [instance: %(uuid)s] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] iscsi_target_flags = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] iscsi_write_cache = on {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] iser_helper = tgtadm {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] iser_ip_address = 192.168.122.31 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] iser_port = 3260 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] log_color = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] log_config_append = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] log_dir = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] log_file = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] log_options = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] log_rotate_interval = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] log_rotate_interval_type = days {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] log_rotation_type = none {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] max_age = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] max_logfile_count = 30 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] max_logfile_size_mb = 200 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] max_over_subscription_ratio = 20.0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] message_reap_interval = 86400 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] message_ttl = 2592000 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:41 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] migration_create_volume_timeout_secs = 300 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] monkey_patch = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] monkey_patch_modules = [] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] my_ip = 192.168.122.31 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] no_snapshot_gb_quota = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] num_iser_scan_tries = 3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] num_shell_tries = 3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] num_volume_device_scan_tries = 3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] nvmeof_conn_info_version = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] nvmet_ns_id = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] nvmet_port_id = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] osapi_max_limit = 1000 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] osapi_volume_ext_list = [] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] osapi_volume_listen_port = 8776 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] osapi_volume_use_ssl = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] osapi_volume_workers = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] per_volume_size_limit = -1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] periodic_fuzzy_delay = 60 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] periodic_interval = 60 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] public_endpoint = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] publish_errors = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] quota_backup_gigabytes = 1000 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] quota_backups = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] quota_gigabytes = 1000 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] quota_groups = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] quota_snapshots = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] quota_volumes = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] rate_limit_burst = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] rate_limit_except_level = CRITICAL {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] rate_limit_interval = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] reinit_driver_count = 3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86966) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] replication_device = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] report_discard_supported = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] report_interval = 120 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] reservation_clean_interval = 86400 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] reservation_expire = 86400 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] reserved_image_namespaces = [] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] reserved_percentage = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] rpc_response_timeout = 120 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] run_external_periodic_tasks = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] scst_target_driver = iscsi {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] scst_target_iqn_name = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] service_down_time = 720 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] shell_completion = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] snapshot_name_template = snapshot-%s {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] split_loggers = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] state_path = /opt/stack/data/cinder {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] storage_availability_zone = nova {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] storage_protocol = iSCSI {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] syslog_log_facility = LOG_USER {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] target_helper = lioadm {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] target_ip_address = 192.168.122.31 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] target_port = 3260 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] target_protocol = iscsi {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] target_secondary_ip_addresses = [] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] trace_flags = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] transport_url = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] until_refresh = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] use_chap_auth = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] use_default_quota_class = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] use_journal = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] use_json = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] use_multipath_for_image_xfer = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] use_stderr = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] use_syslog = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] verify_glance_signatures = enabled {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_api_class = cinder.volume.api.API {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_backend_name = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_clear = zero {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_clear_ionice = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_clear_size = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_copy_bps_limit = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_dd_blocksize = 1M {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_name_template = volume-%s {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_service_inithost_offload = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volume_usage_audit_period = month {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] zoning_mode = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_concurrency.disable_process_locking = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.auth_section = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.auth_type = password {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.auth_version = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.cache = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.certfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.include_service_catalog = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.insecure = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.interface = public {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.keyfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_password = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcache_username = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.region_name = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.service_type = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.31/identity {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.backend = dogpile.cache.null {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.backend_argument = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.backend_expiration_time = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.config_prefix = cache.oslo {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.debug_cache_backend = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.enable_retry_client = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.enable_socket_keepalive = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.enabled = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.expiration_time = 600 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.hashclient_retry_attempts = 2 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.memcache_dead_retry = 300 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.memcache_pool_maxsize = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.memcache_sasl_enabled = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.password = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.proxies = [] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.redis_db = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.redis_server = localhost:6379 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.retry_attempts = 2 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.retry_delay = 0.0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.socket_keepalive_count = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.socket_keepalive_idle = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.socket_keepalive_interval = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.socket_timeout = 1.0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.tls_allowed_ciphers = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.tls_cafile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.tls_certfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.tls_enabled = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.tls_keyfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cache.username = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] coordination.backend_url = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.asyncio_connection = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.asyncio_slave_connection = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.backend = sqlalchemy {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.connection = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.connection_debug = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.connection_parameters = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.connection_recycle_time = 3600 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.connection_trace = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.db_inc_retry_interval = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.db_max_retries = 20 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.db_max_retry_interval = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.db_retry_interval = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.max_overflow = 50 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.max_pool_size = 5 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.max_retries = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.mysql_wsrep_sync_wait = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.pool_timeout = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.retry_interval = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.slave_connection = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.sqlite_synchronous = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.synchronous_reader = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] database.use_db_reconnect = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler.connection_string = messaging:// {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler.enabled = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler.es_doc_type = notification {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler.es_scroll_size = 10000 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler.es_scroll_time = 2m {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler.filter_error_trace = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler.hmac_keys = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler.sentinel_service_name = mymaster {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler.socket_timeout = 0.1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler.trace_requests = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler.trace_sqlalchemy = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler_jaeger.process_tags = {} {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler_jaeger.service_name_prefix = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] profiler_otlp.service_name_prefix = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_policy.enforce_new_defaults = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_policy.enforce_scope = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_policy.policy_default_rule = default {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_policy.policy_file = policy.yaml {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] privsep_osbrick.group = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] privsep_osbrick.helper_command = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] privsep_osbrick.user = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cinder_sys_admin.group = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cinder_sys_admin.helper_command = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] cinder_sys_admin.user = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] service_user.auth_section = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] service_user.auth_type = password {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] service_user.cafile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] service_user.certfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] service_user.collect_timing = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] service_user.insecure = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] service_user.keyfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] service_user.send_service_user_token = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] service_user.split_loggers = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] service_user.timeout = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance.auth_section = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance.auth_type = password {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance.certfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance.collect_timing = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance.insecure = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance.keyfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance.region_name = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance.split_loggers = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] glance.timeout = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.backend_availability_zone = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.chap_password = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.chap_username = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.disk_geometry = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.driver_client_cert = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.driver_client_cert_key = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.driver_data_namespace = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.driver_use_ssl = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.extra_capabilities = {} {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.filter_function = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.goodness_function = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.iscsi_target_flags = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.iscsi_write_cache = on {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.iser_helper = tgtadm {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.iser_ip_address = 192.168.122.31 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.iser_port = 3260 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nas_host = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nas_login = admin {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nas_mount_options = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nas_password = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nas_private_key = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nas_share_path = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86966) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 06:36:42 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.quobyte [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 06:36:42 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.quobyte [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.num_shell_tries = 3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Running cmd (subprocess): mount.quobyte {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.quobyte_volume_url = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.replication_device = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.report_discard_supported = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.reserved_percentage = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.target_helper = tgtadm {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.target_ip_address = 192.168.122.31 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.target_port = 3260 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.target_protocol = iscsi {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.trace_flags = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.unique_fqdn_network = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.use_chap_auth = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.volume_backend_name = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.volume_clear = zero {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.volume_clear_ionice = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.volume_clear_size = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_reports.file_event_handler = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_reports.log_dir = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.backend_availability_zone = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.backend_host = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.chap_password = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.chap_username = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.chiscsi_conf = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.disk_geometry = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.driver_client_cert = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.driver_data_namespace = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.driver_use_ssl = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.extra_capabilities = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.filter_function = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.goodness_function = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.iser_helper = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.iser_ip_address = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.iser_port = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.iser_target_prefix = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nas_host = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nas_login = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nas_mount_options = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nas_password = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nas_private_key = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nas_share_path = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nas_ssh_port = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.num_shell_tries = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.nvmet_port_id = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.replication_device = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.report_discard_supported = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.reserved_percentage = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.scst_target_driver = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.storage_protocol = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.target_helper = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.target_ip_address = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.target_port = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.target_prefix = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.target_protocol = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.trace_flags = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.use_chap_auth = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.volume_clear = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.volume_clear_size = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] QuobyteHD.volumes_dir = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack quobyte-client[86967]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack quobyte-client[86967]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.ssl = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_notifications.driver = [] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_notifications.retry = -1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] key_manager.fixed_key = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.barbican_api_version = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.barbican_endpoint = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.barbican_endpoint_type = public {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.barbican_region_name = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.cafile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.certfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.collect_timing = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.insecure = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.keyfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.number_of_retries = 60 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.retry_delay = 1 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.send_service_user_token = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.split_loggers = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.timeout = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.verify_ssl = True {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican.verify_ssl_path = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican_service_user.auth_section = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican_service_user.auth_type = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican_service_user.cafile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican_service_user.certfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican_service_user.collect_timing = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican_service_user.insecure = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican_service_user.keyfile = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican_service_user.split_loggers = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] barbican_service_user.timeout = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vault.approle_role_id = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vault.approle_secret_id = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vault.kv_mountpoint = secret {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vault.kv_path = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vault.kv_version = 2 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vault.namespace = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vault.root_token_id = **** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vault.ssl_ca_crt_file = None {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vault.timeout = 60.0 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vault.use_ssl = False {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:36:42 devstack cinder-volume[86885]: DEBUG oslo_service.backend._eventlet.service [None req-ac9ff253-bb58-4fc0-bded-e518bb9e3089 None None] ******************************************************************************** {{(pid=86885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 06:36:42 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:36:42 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:42 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.669s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:42 devstack cinder-volume[86966]: INFO cinder.volume.driver [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Driver hasn't implemented _init_vendor_properties() Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG cinder.volume.driver [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540664672852, 'free_capacity_gb': 1775.7540664672852, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86966) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_db.sqlalchemy.engines [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86966) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writer thread running {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG cinder.db.api [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Building query based on filter {{(pid=86966) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86966) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:42 devstack cinder-volume[86966]: INFO cinder.keymgr.migration [None req-a0d5f68e-b48f-4418-abed-838225aeb9e2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 06:36:43 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:36:43 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:43 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.662s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:43 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:36:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Driver initialization completed successfully. Jul 10 06:36:43 devstack cinder-volume[86966]: INFO cinder.manager [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Initiating service 3 cleanup Jul 10 06:36:43 devstack cinder-volume[86966]: INFO cinder.manager [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Service 3 cleanup completed. Jul 10 06:36:43 devstack cinder-volume[86966]: DEBUG cinder.service [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Creating RPC server for service cinder-volume {{(pid=86966) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 06:36:43 devstack cinder-volume[86966]: DEBUG cinder.service [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86966) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 06:36:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 06:36:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:36:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:36:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:43 devstack sudo[87004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:36:43 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:44 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.661s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ba4049af-d878-4499-af53-36dcd3bf1bee None None] Driver post RPC initialization completed successfully. Jul 10 06:36:51 devstack cinder-volume[86885]: DEBUG dbcounter [-] [86885] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:36:53 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:36:54 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:37:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:37:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 6 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:37:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:38:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:38:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:38:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:38:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:38:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:38:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:38:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:11 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:38:11 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:12 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.716s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:38:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:38:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 6 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:38:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:38:54 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:38:54 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Flow 'volume_create_manager' (f8b40f61-b99f-441e-9e61-58d60163521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d778ee7e-e64f-48d6-aac5-f4aa7b5e7d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d778ee7e-e64f-48d6-aac5-f4aa7b5e7d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1391553492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbad5bbb-30b9-473e-a55b-f39d3f973027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41662d4e6ac7476da625536ebdc6ea57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:09Z,use_quota=True,user_id='2960fe1c9dd34e2590af8031bc8b869f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a946712-3f2d-4ad4-94ae-af466e76749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a946712-3f2d-4ad4-94ae-af466e76749c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d814fb1-7420-474c-b33f-66ac8cb0d813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d814fb1-7420-474c-b33f-66ac8cb0d813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbad5bbb-30b9-473e-a55b-f39d3f973027', 'volume_name': 'volume-dbad5bbb-30b9-473e-a55b-f39d3f973027', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a85197-59a8-4e57-9a28-a967c552af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a85197-59a8-4e57-9a28-a967c552af55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a115f0-88c9-43c6-ab78-a7db7ccb559f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Volume dbad5bbb-30b9-473e-a55b-f39d3f973027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbad5bbb-30b9-473e-a55b-f39d3f973027', 'volume_size': 1} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1391553492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbad5bbb-30b9-473e-a55b-f39d3f973027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41662d4e6ac7476da625536ebdc6ea57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:09Z,use_quota=True,user_id='2960fe1c9dd34e2590af8031bc8b869f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Creating volume dbad5bbb-30b9-473e-a55b-f39d3f973027 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:39:09 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:39:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:09 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 1073741824 Jul 10 06:39:09 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:10 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 1073741824" returned: 0 in 1.086s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:10 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 Jul 10 06:39:10 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:11 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027" returned: 0 in 0.823s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a115f0-88c9-43c6-ab78-a7db7ccb559f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbad5bbb-30b9-473e-a55b-f39d3f973027', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7819f84-a1d7-467a-9208-65ce58ecb383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Volume volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 (dbad5bbb-30b9-473e-a55b-f39d3f973027): created successfully Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7819f84-a1d7-467a-9208-65ce58ecb383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Flow 'volume_create_manager' (f8b40f61-b99f-441e-9e61-58d60163521f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f459fd77-7a55-4b37-9043-ee3869748c20 tempest-TaggedAttachmentsTest-57161424 None] Created volume successfully. Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:11 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:39:11 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:12 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.928s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:39:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:39:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 6 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:39:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:39:21 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:39:21 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Flow 'volume_create_manager' (42ac05a9-b6b0-4472-ade4-3e3a95df6a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0883f3-de75-4ed1-8c71-1d25d42b6c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0883f3-de75-4ed1-8c71-1d25d42b6c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1867285290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d5391b-0d45-4ad9-b4af-71df32831340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace27f57bcea4c1981a2d272c1379638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:54Z,use_quota=True,user_id='ec50452de5294000a07e060911f4ab28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e34ba1f-32be-47a8-b9e3-465ebc353c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e34ba1f-32be-47a8-b9e3-465ebc353c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e09877-0936-4e57-9374-574707574e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e09877-0936-4e57-9374-574707574e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d5391b-0d45-4ad9-b4af-71df32831340', 'volume_name': 'volume-90d5391b-0d45-4ad9-b4af-71df32831340', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb09276-4c52-4114-add3-068b5c9126d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb09276-4c52-4114-add3-068b5c9126d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2de28c8-2631-4f9a-882c-2616c88969f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:54 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Volume 90d5391b-0d45-4ad9-b4af-71df32831340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d5391b-0d45-4ad9-b4af-71df32831340', 'volume_size': 1} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1867285290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d5391b-0d45-4ad9-b4af-71df32831340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ace27f57bcea4c1981a2d272c1379638',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:54Z,use_quota=True,user_id='ec50452de5294000a07e060911f4ab28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Creating volume 90d5391b-0d45-4ad9-b4af-71df32831340 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:39:54 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:39:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:54 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340 1073741824 Jul 10 06:39:54 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:56 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340 1073741824" returned: 0 in 2.055s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:56 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340 Jul 10 06:39:56 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:57 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340" returned: 0 in 0.897s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] <== create_volume: return (3072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:39:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.078s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2de28c8-2631-4f9a-882c-2616c88969f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d5391b-0d45-4ad9-b4af-71df32831340', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c15238-3cb9-4d99-ad70-8633dbd37a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Volume volume-90d5391b-0d45-4ad9-b4af-71df32831340 (90d5391b-0d45-4ad9-b4af-71df32831340): created successfully Jul 10 06:39:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c15238-3cb9-4d99-ad70-8633dbd37a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Flow 'volume_create_manager' (42ac05a9-b6b0-4472-ade4-3e3a95df6a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b6bcdbb1-96b5-4450-b5cc-e1815cba6999 tempest-VolumesAdminNegativeTest-390971788 None] Created volume successfully. Jul 10 06:39:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Acquiring lock "cinder-90d5391b-0d45-4ad9-b4af-71df32831340-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:39:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Lock "cinder-90d5391b-0d45-4ad9-b4af-71df32831340-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Acquiring lock "cinder-quobyte-90d5391b-0d45-4ad9-b4af-71df32831340" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Lock "cinder-quobyte-90d5391b-0d45-4ad9-b4af-71df32831340" acquired by "delete_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:00 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpewl3dm_f/privsep.sock'] Jul 10 06:40:00 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpewl3dm_f/privsep.sock Jul 10 06:40:00 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:00 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 06:40:00 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 06:40:00 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 06:40:00 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 06:40:00 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 06:40:00 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 06:40:00 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 06:40:00 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 06:40:00 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 06:40:01 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 06:40:01 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 06:40:01 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 06:40:01 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 06:40:01 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 06:40:01 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 06:40:01 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 06:40:01 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 06:40:01 devstack cinder-volume[86966]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 06:40:02 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:02 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Spawned new privsep daemon via rootwrap Jul 10 06:40:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Accepted privsep connection to /tmp/tmpewl3dm_f/privsep.sock {{(pid=86966) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 06:40:02 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 06:40:02 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 06:40:02 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 06:40:02 devstack cinder-volume[86966]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88427 Jul 10 06:40:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7250f40f-6e36-476f-bf03-a6eca595e30f]: (2,) {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fe82a1-48c6-4409-a939-c91f8c4a5b6f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:02 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340 Jul 10 06:40:02 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:03 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340" returned: 0 in 1.172s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:03 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340 Jul 10 06:40:03 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:04 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-90d5391b-0d45-4ad9-b4af-71df32831340" returned: 0 in 0.901s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Lock "cinder-quobyte-90d5391b-0d45-4ad9-b4af-71df32831340" released by "delete_volume" :: held 4.446s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:04 devstack cinder-volume[86966]: WARNING cinder.quota [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:40:04 devstack cinder-volume[86966]: WARNING cinder.quota [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:40:04 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Created reservations ['7901c9c2-a388-4e1b-8a1b-c481dfc06a55', '8af9a86f-33c6-473a-80b1-daf7ae2aef35', '63487648-9160-4777-9008-c6fc0396a87a', '9b54569c-c1ad-4a50-a499-5cf2b385ff19'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:40:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:04 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:40:04 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:05 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.937s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:05 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Deleted volume successfully. Jul 10 06:40:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-daa31469-ee8d-4b7c-844b-7904cd5d18cf tempest-VolumesAdminNegativeTest-390971788 None] Lock "cinder-90d5391b-0d45-4ad9-b4af-71df32831340-delete_volume" released by "delete_volume" :: held 5.906s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Flow 'volume_create_manager' (6f9d1001-7d13-4ac2-94b4-f040ed420818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010eb936-a23e-40f7-bd16-b1e7f47c97fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010eb936-a23e-40f7-bd16-b1e7f47c97fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1618261925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0982f5a0-1940-458f-8c11-8983782b30fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab983faa3c0461c9deb3771e1869874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:07Z,use_quota=True,user_id='6acbd44d162b4d2c8d736609b1db0a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e01aca6-ced7-4a1c-aee5-4c0279ee3ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e01aca6-ced7-4a1c-aee5-4c0279ee3ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a7aa1a-c320-4773-af93-3f2980a815a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a7aa1a-c320-4773-af93-3f2980a815a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0982f5a0-1940-458f-8c11-8983782b30fa', 'volume_name': 'volume-0982f5a0-1940-458f-8c11-8983782b30fa', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8254c307-9e79-4a9b-8e55-726fb91c0609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8254c307-9e79-4a9b-8e55-726fb91c0609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92dbdeb-1683-466b-a567-a73843bb3fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Volume 0982f5a0-1940-458f-8c11-8983782b30fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0982f5a0-1940-458f-8c11-8983782b30fa', 'volume_size': 1} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1618261925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0982f5a0-1940-458f-8c11-8983782b30fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab983faa3c0461c9deb3771e1869874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:07Z,use_quota=True,user_id='6acbd44d162b4d2c8d736609b1db0a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Creating volume 0982f5a0-1940-458f-8c11-8983782b30fa {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:40:07 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:40:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:07 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa 1073741824 Jul 10 06:40:07 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:08 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa 1073741824" returned: 0 in 1.248s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:08 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa Jul 10 06:40:08 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:09 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa" returned: 0 in 0.764s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] <== create_volume: return (2137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:40:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.140s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92dbdeb-1683-466b-a567-a73843bb3fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0982f5a0-1940-458f-8c11-8983782b30fa', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c13a45-eee0-42ec-a8a5-fddd16cfa9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Volume volume-0982f5a0-1940-458f-8c11-8983782b30fa (0982f5a0-1940-458f-8c11-8983782b30fa): created successfully Jul 10 06:40:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c13a45-eee0-42ec-a8a5-fddd16cfa9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Flow 'volume_create_manager' (6f9d1001-7d13-4ac2-94b4-f040ed420818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d50df365-7c13-4300-b659-ab61aee4d14f tempest-AttachVolumeNegativeTest-1558798489 None] Created volume successfully. Jul 10 06:40:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:40:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:11 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:40:11 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:12 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.728s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:16 devstack cinder-volume[86966]: WARNING py.warnings [req-ecd41008-17f1-44c5-83b9-20733c7ff3ea req-5ef399f0-36ea-4773-b66e-eee74dea86af tempest-AttachVolumeNegativeTest-1558798489 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 10 06:40:16 devstack cinder-volume[86966]: .first() Jul 10 06:40:16 devstack cinder-volume[86966]: Jul 10 06:40:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ecd41008-17f1-44c5-83b9-20733c7ff3ea req-5ef399f0-36ea-4773-b66e-eee74dea86af tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ecd41008-17f1-44c5-83b9-20733c7ff3ea req-5ef399f0-36ea-4773-b66e-eee74dea86af tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[83db10eb-a266-40e3-b152-61d2fdf58352]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-ecd41008-17f1-44c5-83b9-20733c7ff3ea req-5ef399f0-36ea-4773-b66e-eee74dea86af tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:16 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa Jul 10 06:40:16 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:16 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-ecd41008-17f1-44c5-83b9-20733c7ff3ea req-5ef399f0-36ea-4773-b66e-eee74dea86af tempest-AttachVolumeNegativeTest-1558798489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa" returned: 0 in 0.900s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ecd41008-17f1-44c5-83b9-20733c7ff3ea req-5ef399f0-36ea-4773-b66e-eee74dea86af tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.934s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-ecd41008-17f1-44c5-83b9-20733c7ff3ea req-5ef399f0-36ea-4773-b66e-eee74dea86af tempest-AttachVolumeNegativeTest-1558798489 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-0982f5a0-1940-458f-8c11-8983782b30fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31bbe796-63bf-4211-82b7-22bdf411d704', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:40:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-ecd41008-17f1-44c5-83b9-20733c7ff3ea req-5ef399f0-36ea-4773-b66e-eee74dea86af tempest-AttachVolumeNegativeTest-1558798489 None] attachment_update completed successfully. Jul 10 06:40:27 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=17,cinder:SELECT=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:40:27 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Flow 'volume_create_manager' (6d9faab8-7a88-479e-89d2-76b5e2f97ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82912a7e-f489-451e-9006-e758b2c84d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82912a7e-f489-451e-9006-e758b2c84d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1192799688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2274445e-fc1d-414f-90bc-3029df21b024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a04bf5f88b4f25933ee6e9eff4614d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:35Z,use_quota=True,user_id='7cff0a30b6f44318823be67d5ab2bbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b22d96-9782-4966-8a39-41249a18a41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b22d96-9782-4966-8a39-41249a18a41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2db029a-adfc-41ce-be15-99b7b60112e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2db029a-adfc-41ce-be15-99b7b60112e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2274445e-fc1d-414f-90bc-3029df21b024', 'volume_name': 'volume-2274445e-fc1d-414f-90bc-3029df21b024', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc1acbf-f3ac-4d49-9f21-930c84a6af3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc1acbf-f3ac-4d49-9f21-930c84a6af3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb9a6e1-a720-4024-9699-29cdd4e1c83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:34 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Volume 2274445e-fc1d-414f-90bc-3029df21b024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2274445e-fc1d-414f-90bc-3029df21b024', 'volume_size': 1} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1192799688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2274445e-fc1d-414f-90bc-3029df21b024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a04bf5f88b4f25933ee6e9eff4614d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:35Z,use_quota=True,user_id='7cff0a30b6f44318823be67d5ab2bbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Creating volume 2274445e-fc1d-414f-90bc-3029df21b024 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:40:35 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:40:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:35 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024 1073741824 Jul 10 06:40:35 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:36 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024 1073741824" returned: 0 in 1.404s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:36 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024 Jul 10 06:40:36 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:37 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024" returned: 0 in 1.170s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] <== create_volume: return (2660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:40:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.662s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb9a6e1-a720-4024-9699-29cdd4e1c83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2274445e-fc1d-414f-90bc-3029df21b024', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71136f54-25b5-4319-9971-42cb1ead2b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:37 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Volume volume-2274445e-fc1d-414f-90bc-3029df21b024 (2274445e-fc1d-414f-90bc-3029df21b024): created successfully Jul 10 06:40:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71136f54-25b5-4319-9971-42cb1ead2b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Flow 'volume_create_manager' (6d9faab8-7a88-479e-89d2-76b5e2f97ef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d66917ec-cf9d-49f3-8667-4af256f73298 tempest-DeleteServersTestJSON-1167621286 None] Created volume successfully. Jul 10 06:40:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-7036a666-8088-493f-87f6-2be79ec3385e req-a0caa4c7-c4c1-4329-a19f-ce5a2792b8f9 tempest-DeleteServersTestJSON-1167621286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-7036a666-8088-493f-87f6-2be79ec3385e req-a0caa4c7-c4c1-4329-a19f-ce5a2792b8f9 tempest-DeleteServersTestJSON-1167621286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:43 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cce96d-5a5e-4334-893e-b3ae1a04be52]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-7036a666-8088-493f-87f6-2be79ec3385e req-a0caa4c7-c4c1-4329-a19f-ce5a2792b8f9 tempest-DeleteServersTestJSON-1167621286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:43 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024 Jul 10 06:40:43 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:44 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-7036a666-8088-493f-87f6-2be79ec3385e req-a0caa4c7-c4c1-4329-a19f-ce5a2792b8f9 tempest-DeleteServersTestJSON-1167621286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024" returned: 0 in 1.121s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-7036a666-8088-493f-87f6-2be79ec3385e req-a0caa4c7-c4c1-4329-a19f-ce5a2792b8f9 tempest-DeleteServersTestJSON-1167621286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.152s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-7036a666-8088-493f-87f6-2be79ec3385e req-a0caa4c7-c4c1-4329-a19f-ce5a2792b8f9 tempest-DeleteServersTestJSON-1167621286 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-2274445e-fc1d-414f-90bc-3029df21b024', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e16b67a0-8b4f-446d-8802-bed3d91168df', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:40:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-7036a666-8088-493f-87f6-2be79ec3385e req-a0caa4c7-c4c1-4329-a19f-ce5a2792b8f9 tempest-DeleteServersTestJSON-1167621286 None] attachment_update completed successfully. Jul 10 06:40:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-656afcf9-7f5f-4304-8309-d7d48fbe1377 req-d1958935-9626-4d85-ba88-bec6f307e006 tempest-TaggedAttachmentsTest-57161424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-656afcf9-7f5f-4304-8309-d7d48fbe1377 req-d1958935-9626-4d85-ba88-bec6f307e006 tempest-TaggedAttachmentsTest-57161424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2b6ee2-f613-4b5d-ab1e-5a45a3a8558a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-656afcf9-7f5f-4304-8309-d7d48fbe1377 req-d1958935-9626-4d85-ba88-bec6f307e006 tempest-TaggedAttachmentsTest-57161424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:47 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 Jul 10 06:40:47 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:48 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-656afcf9-7f5f-4304-8309-d7d48fbe1377 req-d1958935-9626-4d85-ba88-bec6f307e006 tempest-TaggedAttachmentsTest-57161424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027" returned: 0 in 1.661s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-656afcf9-7f5f-4304-8309-d7d48fbe1377 req-d1958935-9626-4d85-ba88-bec6f307e006 tempest-TaggedAttachmentsTest-57161424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.705s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-656afcf9-7f5f-4304-8309-d7d48fbe1377 req-d1958935-9626-4d85-ba88-bec6f307e006 tempest-TaggedAttachmentsTest-57161424 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-dbad5bbb-30b9-473e-a55b-f39d3f973027', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6c19b98-2c3a-4220-928e-c9867b80b937', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:40:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-656afcf9-7f5f-4304-8309-d7d48fbe1377 req-d1958935-9626-4d85-ba88-bec6f307e006 tempest-TaggedAttachmentsTest-57161424 None] attachment_update completed successfully. Jul 10 06:40:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-a6fe7438-5ab1-4082-a731-315202ab3541 req-a67c49c6-418f-4886-a095-d37b1ae43262 tempest-DeleteServersTestJSON-1167621286 None] Terminate volume connection completed successfully. Jul 10 06:40:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-a6fe7438-5ab1-4082-a731-315202ab3541 req-a67c49c6-418f-4886-a095-d37b1ae43262 tempest-DeleteServersTestJSON-1167621286 None] Deleting attachment e16b67a0-8b4f-446d-8802-bed3d91168df. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:40:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-5d271fe2-49ac-4717-9c9b-6e24de214811 req-609abcde-6968-4e3e-a7e5-1eb57244bad1 tempest-TaggedAttachmentsTest-57161424 None] Terminate volume connection completed successfully. Jul 10 06:40:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5d271fe2-49ac-4717-9c9b-6e24de214811 req-609abcde-6968-4e3e-a7e5-1eb57244bad1 tempest-TaggedAttachmentsTest-57161424 None] Deleting attachment a6c19b98-2c3a-4220-928e-c9867b80b937. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:41:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Acquiring lock "cinder-2274445e-fc1d-414f-90bc-3029df21b024-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Lock "cinder-2274445e-fc1d-414f-90bc-3029df21b024-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Acquiring lock "cinder-quobyte-2274445e-fc1d-414f-90bc-3029df21b024" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Lock "cinder-quobyte-2274445e-fc1d-414f-90bc-3029df21b024" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f1cb59-d7a7-40cb-960f-a295c3041d8e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:00 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024 Jul 10 06:41:00 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:01 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024" returned: 0 in 0.871s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:01 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024 Jul 10 06:41:01 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:02 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2274445e-fc1d-414f-90bc-3029df21b024" returned: 0 in 0.799s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Lock "cinder-quobyte-2274445e-fc1d-414f-90bc-3029df21b024" released by "delete_volume" :: held 1.710s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:02 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Created reservations ['b623a9fb-bef3-4822-922d-041b7718393c', '30e5fb48-cb9e-43d8-b7e4-ecec38ba677c', '839ba98e-a451-465f-abfb-71b195a11876', 'c8bb45d7-ff15-4041-9d89-87cadcdf8a49'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:02 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:41:02 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:03 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.903s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Deleted volume successfully. Jul 10 06:41:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-36c5841d-c656-4566-b6e3-2b84f1ef49cb tempest-DeleteServersTestJSON-1167621286 None] Lock "cinder-2274445e-fc1d-414f-90bc-3029df21b024-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:41:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:11 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:41:11 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:12 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=14,cinder:SELECT=21,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:41:12 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.360s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:41:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 8 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:41:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:41:13 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=20,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:41:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Acquiring lock "cinder-dbad5bbb-30b9-473e-a55b-f39d3f973027-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Lock "cinder-dbad5bbb-30b9-473e-a55b-f39d3f973027-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Acquiring lock "cinder-quobyte-dbad5bbb-30b9-473e-a55b-f39d3f973027" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Lock "cinder-quobyte-dbad5bbb-30b9-473e-a55b-f39d3f973027" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ce6ce6-016e-4c0e-8e40-02efd22fea41]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:17 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 Jul 10 06:41:17 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:18 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027" returned: 0 in 1.341s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:18 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027 Jul 10 06:41:18 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:19 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dbad5bbb-30b9-473e-a55b-f39d3f973027" returned: 0 in 0.876s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Lock "cinder-quobyte-dbad5bbb-30b9-473e-a55b-f39d3f973027" released by "delete_volume" :: held 2.305s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:19 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Created reservations ['7335b1a5-8811-47d2-9f6a-798694d9a2e2', '8b4f23fc-f072-4923-b40d-a05129a4a6ed', '152e0661-184d-4f8b-9d0e-3a90b5f8ef9a', '2ca6233d-64b9-4b61-98ac-571de1e9a38b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:19 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:41:19 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-22037998-9e33-49f9-89a6-825b05c427d2 req-a4008797-f7e5-4cc0-ac8d-f824b5942250 tempest-AttachVolumeNegativeTest-1558798489 None] Terminate volume connection completed successfully. Jul 10 06:41:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-22037998-9e33-49f9-89a6-825b05c427d2 req-a4008797-f7e5-4cc0-ac8d-f824b5942250 tempest-AttachVolumeNegativeTest-1558798489 None] Deleting attachment 31bbe796-63bf-4211-82b7-22bdf411d704. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:41:20 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.788s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:20 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Deleted volume successfully. Jul 10 06:41:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0b9fc6db-c50a-4f54-9054-6370dbdc5000 tempest-TaggedAttachmentsTest-57161424 None] Lock "cinder-dbad5bbb-30b9-473e-a55b-f39d3f973027-delete_volume" released by "delete_volume" :: held 3.386s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:30 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:41:30 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Flow 'volume_create_manager' (b2c47583-4640-4911-930d-e704bb528120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb419f88-5395-430a-a9f1-0760e68a6fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb419f88-5395-430a-a9f1-0760e68a6fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-917066269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3509b916-dd4b-4bdd-992f-d162d21a14ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7518a56a8728481a8f1ef19d4377c5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:37Z,use_quota=True,user_id='c407ec4b29354fe7974242596edd944a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a0f67f-57d3-4c19-8785-20172abeb89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a0f67f-57d3-4c19-8785-20172abeb89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e7301e-2fec-4208-a191-b9954e7c06f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e7301e-2fec-4208-a191-b9954e7c06f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3509b916-dd4b-4bdd-992f-d162d21a14ea', 'volume_name': 'volume-3509b916-dd4b-4bdd-992f-d162d21a14ea', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2b9dda-80d2-416e-b200-05ab16a993b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2b9dda-80d2-416e-b200-05ab16a993b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a3a663-689f-4073-b83b-f6dcefbd4703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:36 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Volume 3509b916-dd4b-4bdd-992f-d162d21a14ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3509b916-dd4b-4bdd-992f-d162d21a14ea', 'volume_size': 1} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-917066269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3509b916-dd4b-4bdd-992f-d162d21a14ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7518a56a8728481a8f1ef19d4377c5f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:37Z,use_quota=True,user_id='c407ec4b29354fe7974242596edd944a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Creating volume 3509b916-dd4b-4bdd-992f-d162d21a14ea {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:41:36 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:41:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:36 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea 1073741824 Jul 10 06:41:36 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:38 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea 1073741824" returned: 0 in 1.629s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:38 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea Jul 10 06:41:38 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:39 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea" returned: 0 in 1.086s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] <== create_volume: return (2794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:41:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.802s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a3a663-689f-4073-b83b-f6dcefbd4703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3509b916-dd4b-4bdd-992f-d162d21a14ea', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ed5f03-5751-4825-b1df-6fe952328e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:39 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Volume volume-3509b916-dd4b-4bdd-992f-d162d21a14ea (3509b916-dd4b-4bdd-992f-d162d21a14ea): created successfully Jul 10 06:41:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ed5f03-5751-4825-b1df-6fe952328e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Flow 'volume_create_manager' (b2c47583-4640-4911-930d-e704bb528120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-89d86de7-9b37-4b8a-b50f-7dfd06c8cfcf tempest-ServerActionsTestOtherA-298552737 None] Created volume successfully. Jul 10 06:41:49 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:41:49 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:42:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:42:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:11 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:42:11 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Flow 'volume_create_manager' (13185be0-0bcc-4340-a5df-d5390e0c994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e412b4-4bf4-4e0f-85e3-93766e0457f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e412b4-4bf4-4e0f-85e3-93766e0457f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1861048567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58869856-71d4-454a-9367-816d64bf8d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c28e06d6210477c9d33cf0e57a8b48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:12Z,use_quota=True,user_id='655712f3fa7e4c84ad42fb976836a305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c4c715-addb-46b1-97d4-083cff9f77a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c4c715-addb-46b1-97d4-083cff9f77a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7c6631-2c74-467b-ae0c-762f2ee971a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7c6631-2c74-467b-ae0c-762f2ee971a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58869856-71d4-454a-9367-816d64bf8d2f', 'volume_name': 'volume-58869856-71d4-454a-9367-816d64bf8d2f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d198c6-1eff-47ea-958c-a1b75d9e3ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d198c6-1eff-47ea-958c-a1b75d9e3ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481bc5b9-0b80-4c50-b6a9-fb6ed0c7046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:12 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Volume 58869856-71d4-454a-9367-816d64bf8d2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58869856-71d4-454a-9367-816d64bf8d2f', 'volume_size': 1} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1861048567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58869856-71d4-454a-9367-816d64bf8d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c28e06d6210477c9d33cf0e57a8b48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:12Z,use_quota=True,user_id='655712f3fa7e4c84ad42fb976836a305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Creating volume 58869856-71d4-454a-9367-816d64bf8d2f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:12 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:12 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f 1073741824 Jul 10 06:42:12 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:12 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.334s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:42:13 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f 1073741824" returned: 0 in 1.523s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:14 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f Jul 10 06:42:14 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:15 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f" returned: 0 in 1.647s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] <== create_volume: return (3252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.257s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481bc5b9-0b80-4c50-b6a9-fb6ed0c7046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58869856-71d4-454a-9367-816d64bf8d2f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747ba683-f067-4b42-b9d8-8bc928d32794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Volume volume-58869856-71d4-454a-9367-816d64bf8d2f (58869856-71d4-454a-9367-816d64bf8d2f): created successfully Jul 10 06:42:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747ba683-f067-4b42-b9d8-8bc928d32794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Flow 'volume_create_manager' (13185be0-0bcc-4340-a5df-d5390e0c994f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c6069145-9dd9-4a59-91b9-3d56a3330769 tempest-ServerRescueNegativeTestJSON-1455789801 None] Created volume successfully. Jul 10 06:42:25 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:42:25 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Flow 'volume_create_manager' (35d2cb77-b181-47de-a727-43e6645e82cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcce7d55-4b8e-47ec-92b4-a96404b5e785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcce7d55-4b8e-47ec-92b4-a96404b5e785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1437123958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28cfbfa-ae11-48b1-8951-cb27dffbd60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab983faa3c0461c9deb3771e1869874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:26Z,use_quota=True,user_id='6acbd44d162b4d2c8d736609b1db0a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94b602a-d744-437b-8493-9cbcad42cc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94b602a-d744-437b-8493-9cbcad42cc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7badc2-2c97-4205-a74b-2b9c39bf7c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7badc2-2c97-4205-a74b-2b9c39bf7c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28cfbfa-ae11-48b1-8951-cb27dffbd60c', 'volume_name': 'volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070a2eb7-2c3d-444d-9c0b-7612c3630bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070a2eb7-2c3d-444d-9c0b-7612c3630bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4524a8c8-f9bc-4c7a-9b34-3e7120b80a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Volume f28cfbfa-ae11-48b1-8951-cb27dffbd60c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c', 'volume_size': 1} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1437123958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28cfbfa-ae11-48b1-8951-cb27dffbd60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab983faa3c0461c9deb3771e1869874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:26Z,use_quota=True,user_id='6acbd44d162b4d2c8d736609b1db0a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Creating volume f28cfbfa-ae11-48b1-8951-cb27dffbd60c {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:26 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:42:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:26 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c 1073741824 Jul 10 06:42:26 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:27 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c 1073741824" returned: 0 in 1.155s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:27 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c Jul 10 06:42:27 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:28 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c" returned: 0 in 1.065s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] <== create_volume: return (2265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4524a8c8-f9bc-4c7a-9b34-3e7120b80a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9931f19-2acd-4464-8cfb-d9e85636e9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Volume volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c (f28cfbfa-ae11-48b1-8951-cb27dffbd60c): created successfully Jul 10 06:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9931f19-2acd-4464-8cfb-d9e85636e9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Flow 'volume_create_manager' (35d2cb77-b181-47de-a727-43e6645e82cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4ca375cf-d0b5-436a-97ab-3cbfe84fa16b tempest-AttachVolumeNegativeTest-1558798489 None] Created volume successfully. Jul 10 06:42:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-e09d241d-17f3-46e4-adf3-bd23ca6bcc95 req-092150ac-a25e-4867-a296-ce7e43d647ab tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-e09d241d-17f3-46e4-adf3-bd23ca6bcc95 req-092150ac-a25e-4867-a296-ce7e43d647ab tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ba24dd-9c76-4a2d-8db9-06337b7697c8]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-e09d241d-17f3-46e4-adf3-bd23ca6bcc95 req-092150ac-a25e-4867-a296-ce7e43d647ab tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:34 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c Jul 10 06:42:34 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ecaaa6e5-87eb-4481-9846-312e0cc61e27 req-ce17d483-9cb2-4571-9a63-c729c277770f tempest-ServerActionsTestOtherA-298552737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:35 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-e09d241d-17f3-46e4-adf3-bd23ca6bcc95 req-092150ac-a25e-4867-a296-ce7e43d647ab tempest-AttachVolumeNegativeTest-1558798489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c" returned: 0 in 2.179s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-e09d241d-17f3-46e4-adf3-bd23ca6bcc95 req-092150ac-a25e-4867-a296-ce7e43d647ab tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.266s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ecaaa6e5-87eb-4481-9846-312e0cc61e27 req-ce17d483-9cb2-4571-9a63-c729c277770f tempest-ServerActionsTestOtherA-298552737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.511s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e0cda6-a261-40d3-a86c-d9c937d39e7d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-ecaaa6e5-87eb-4481-9846-312e0cc61e27 req-ce17d483-9cb2-4571-9a63-c729c277770f tempest-ServerActionsTestOtherA-298552737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-e09d241d-17f3-46e4-adf3-bd23ca6bcc95 req-092150ac-a25e-4867-a296-ce7e43d647ab tempest-AttachVolumeNegativeTest-1558798489 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b0177b6-6f24-4ca8-8910-7e5bfa54a471', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:42:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-e09d241d-17f3-46e4-adf3-bd23ca6bcc95 req-092150ac-a25e-4867-a296-ce7e43d647ab tempest-AttachVolumeNegativeTest-1558798489 None] attachment_update completed successfully. Jul 10 06:42:36 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea Jul 10 06:42:36 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Acquiring lock "cinder-58869856-71d4-454a-9367-816d64bf8d2f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Lock "cinder-58869856-71d4-454a-9367-816d64bf8d2f-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Acquiring lock "cinder-quobyte-58869856-71d4-454a-9367-816d64bf8d2f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Lock "cinder-quobyte-58869856-71d4-454a-9367-816d64bf8d2f" acquired by "delete_volume" :: waited 0.051s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:37 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27bd8e9-6f6b-43e9-a47d-9aba99f7a092]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:37 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f Jul 10 06:42:37 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:38 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-ecaaa6e5-87eb-4481-9846-312e0cc61e27 req-ce17d483-9cb2-4571-9a63-c729c277770f tempest-ServerActionsTestOtherA-298552737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea" returned: 0 in 2.138s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ecaaa6e5-87eb-4481-9846-312e0cc61e27 req-ce17d483-9cb2-4571-9a63-c729c277770f tempest-ServerActionsTestOtherA-298552737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.187s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-ecaaa6e5-87eb-4481-9846-312e0cc61e27 req-ce17d483-9cb2-4571-9a63-c729c277770f tempest-ServerActionsTestOtherA-298552737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-3509b916-dd4b-4bdd-992f-d162d21a14ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17ae8251-e749-44c4-8f1b-b13068842e6a', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:42:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-ecaaa6e5-87eb-4481-9846-312e0cc61e27 req-ce17d483-9cb2-4571-9a63-c729c277770f tempest-ServerActionsTestOtherA-298552737 None] attachment_update completed successfully. Jul 10 06:42:39 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f" returned: 0 in 1.755s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:39 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f Jul 10 06:42:39 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:40 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58869856-71d4-454a-9367-816d64bf8d2f" returned: 0 in 0.738s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Lock "cinder-quobyte-58869856-71d4-454a-9367-816d64bf8d2f" released by "delete_volume" :: held 2.563s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:40 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Created reservations ['da4c705c-1bdc-4c75-8ada-d9728e130ff6', 'b86e5dcb-fcb5-4ca9-9aad-f0f6cdc9bf5c', '47616945-cbde-47d3-905d-a7a1b51f359a', '5d632493-2e63-4b70-9354-64900ccbf942'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:40 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:42:40 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:41 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.278s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:41 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:42:41 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Deleted volume successfully. Jul 10 06:42:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-036aad83-11c6-4e71-9ae8-dda99768c683 tempest-ServerRescueNegativeTestJSON-1455789801 None] Lock "cinder-58869856-71d4-454a-9367-816d64bf8d2f-delete_volume" released by "delete_volume" :: held 4.359s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-28ea49a4-18be-4d20-bb0e-8dcc0bf41b88 req-aa793c94-aab4-4789-8318-dc76b92cdcab tempest-AttachVolumeNegativeTest-1558798489 None] Terminate volume connection completed successfully. Jul 10 06:42:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-28ea49a4-18be-4d20-bb0e-8dcc0bf41b88 req-aa793c94-aab4-4789-8318-dc76b92cdcab tempest-AttachVolumeNegativeTest-1558798489 None] Deleting attachment 4b0177b6-6f24-4ca8-8910-7e5bfa54a471. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:42:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-b19d831d-f074-491c-9de8-538c42776ad8 req-bf866d46-90d4-491b-ab9c-16ebf709e429 tempest-ServerActionsTestOtherA-298552737 None] Terminate volume connection completed successfully. Jul 10 06:42:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-b19d831d-f074-491c-9de8-538c42776ad8 req-bf866d46-90d4-491b-ab9c-16ebf709e429 tempest-ServerActionsTestOtherA-298552737 None] Deleting attachment 17ae8251-e749-44c4-8f1b-b13068842e6a. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:42:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b19d831d-f074-491c-9de8-538c42776ad8 req-ad019405-f819-46c5-abcf-6c5a6f81af9f tempest-ServerActionsTestOtherA-298552737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b19d831d-f074-491c-9de8-538c42776ad8 req-ad019405-f819-46c5-abcf-6c5a6f81af9f tempest-ServerActionsTestOtherA-298552737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:52 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[95254e8d-ea60-4e65-8c88-5356de9bbbae]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b19d831d-f074-491c-9de8-538c42776ad8 req-ad019405-f819-46c5-abcf-6c5a6f81af9f tempest-ServerActionsTestOtherA-298552737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:52 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea Jul 10 06:42:52 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:53 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b19d831d-f074-491c-9de8-538c42776ad8 req-ad019405-f819-46c5-abcf-6c5a6f81af9f tempest-ServerActionsTestOtherA-298552737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea" returned: 0 in 1.192s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b19d831d-f074-491c-9de8-538c42776ad8 req-ad019405-f819-46c5-abcf-6c5a6f81af9f tempest-ServerActionsTestOtherA-298552737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.232s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-b19d831d-f074-491c-9de8-538c42776ad8 req-ad019405-f819-46c5-abcf-6c5a6f81af9f tempest-ServerActionsTestOtherA-298552737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-3509b916-dd4b-4bdd-992f-d162d21a14ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de4fa355-4a10-4f4a-93b3-ca6081814650', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:42:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-b19d831d-f074-491c-9de8-538c42776ad8 req-ad019405-f819-46c5-abcf-6c5a6f81af9f tempest-ServerActionsTestOtherA-298552737 None] attachment_update completed successfully. Jul 10 06:42:58 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Flow 'volume_create_manager' (41e00026-b6d6-497d-98ce-d0c6ab66e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79979528-9401-44b6-a718-543c8ac5f322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79979528-9401-44b6-a718-543c8ac5f322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1202443396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e92923-9d49-4918-8849-ec7bcf4c5d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a5c6c84f99436da9faea6be0fd3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:59Z,use_quota=True,user_id='9701cdf8cfa84456955ce00c11e341b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5151b866-6730-4eb9-b063-62476203b6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5151b866-6730-4eb9-b063-62476203b6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddfe686-80ce-4cfe-a23d-b2ccb32dcbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddfe686-80ce-4cfe-a23d-b2ccb32dcbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e92923-9d49-4918-8849-ec7bcf4c5d40', 'volume_name': 'volume-61e92923-9d49-4918-8849-ec7bcf4c5d40', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0250213b-58c2-4d44-abd7-54e15b2c5488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0250213b-58c2-4d44-abd7-54e15b2c5488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a868db9-0fd7-4604-a9b8-5ba63d970ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:59 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Volume 61e92923-9d49-4918-8849-ec7bcf4c5d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e92923-9d49-4918-8849-ec7bcf4c5d40', 'volume_size': 1} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1202443396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e92923-9d49-4918-8849-ec7bcf4c5d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a5c6c84f99436da9faea6be0fd3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:59Z,use_quota=True,user_id='9701cdf8cfa84456955ce00c11e341b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Creating volume 61e92923-9d49-4918-8849-ec7bcf4c5d40 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:59 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:42:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:59 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40 1073741824 Jul 10 06:42:59 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:00 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40 1073741824" returned: 0 in 1.125s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:00 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40 Jul 10 06:43:00 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:01 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40" returned: 0 in 0.960s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:43:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a868db9-0fd7-4604-a9b8-5ba63d970ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e92923-9d49-4918-8849-ec7bcf4c5d40', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fd1887-52de-49a4-b630-207577529a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:01 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Volume volume-61e92923-9d49-4918-8849-ec7bcf4c5d40 (61e92923-9d49-4918-8849-ec7bcf4c5d40): created successfully Jul 10 06:43:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fd1887-52de-49a4-b630-207577529a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Flow 'volume_create_manager' (41e00026-b6d6-497d-98ce-d0c6ab66e14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4eae049e-861d-4b9e-8f6c-6a2ca353b3d8 tempest-ServersNegativeTestJSON-1816411984 None] Created volume successfully. Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Flow 'volume_create_manager' (0dda43b3-b2de-49b0-bf1d-969453978983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae8b933-836d-4e1f-9081-9ff4e02c8e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae8b933-836d-4e1f-9081-9ff4e02c8e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2056882377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515f66ba-2145-49df-9d03-4e1a474b9263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a5c6c84f99436da9faea6be0fd3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:05Z,use_quota=True,user_id='9701cdf8cfa84456955ce00c11e341b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fb32b0-c3df-4a09-8934-f752e8b8e584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fb32b0-c3df-4a09-8934-f752e8b8e584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1704af-d13f-43c8-9aae-9fd0f1896be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1704af-d13f-43c8-9aae-9fd0f1896be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '515f66ba-2145-49df-9d03-4e1a474b9263', 'volume_name': 'volume-515f66ba-2145-49df-9d03-4e1a474b9263', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6058f093-a989-43ec-ac0c-97599feefa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6058f093-a989-43ec-ac0c-97599feefa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e7718a-1e28-4721-872a-8126f24fed16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Volume 515f66ba-2145-49df-9d03-4e1a474b9263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-515f66ba-2145-49df-9d03-4e1a474b9263', 'volume_size': 1} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2056882377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515f66ba-2145-49df-9d03-4e1a474b9263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a5c6c84f99436da9faea6be0fd3eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:05Z,use_quota=True,user_id='9701cdf8cfa84456955ce00c11e341b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Creating volume 515f66ba-2145-49df-9d03-4e1a474b9263 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:43:05 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:43:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:05 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263 1073741824 Jul 10 06:43:05 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:06 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263 1073741824" returned: 0 in 1.313s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:06 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263 Jul 10 06:43:06 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:07 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263" returned: 0 in 0.777s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:43:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e7718a-1e28-4721-872a-8126f24fed16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515f66ba-2145-49df-9d03-4e1a474b9263', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce25a44-e8f0-4bf8-a1ef-994ae18fb867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Volume volume-515f66ba-2145-49df-9d03-4e1a474b9263 (515f66ba-2145-49df-9d03-4e1a474b9263): created successfully Jul 10 06:43:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce25a44-e8f0-4bf8-a1ef-994ae18fb867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Flow 'volume_create_manager' (0dda43b3-b2de-49b0-bf1d-969453978983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b3951941-b2fb-4eea-b52c-aa309d0b8d99 tempest-ServersNegativeTestJSON-1816411984 None] Created volume successfully. Jul 10 06:43:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Acquiring lock "cinder-515f66ba-2145-49df-9d03-4e1a474b9263-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Lock "cinder-515f66ba-2145-49df-9d03-4e1a474b9263-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Acquiring lock "cinder-quobyte-515f66ba-2145-49df-9d03-4e1a474b9263" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Lock "cinder-quobyte-515f66ba-2145-49df-9d03-4e1a474b9263" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69d7470-9436-4cbc-a167-f334bab8ef9a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:09 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263 Jul 10 06:43:09 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:10 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263" returned: 0 in 1.368s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:10 devstack sudo[91676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263 Jul 10 06:43:10 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:10 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Flow 'volume_create_manager' (438d7714-dff5-4023-82aa-50ac605881a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e80d76-6c16-45a9-8fca-81d731e3fe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e80d76-6c16-45a9-8fca-81d731e3fe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-996315451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9aecbefd1734c109dfc145e40d7d90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:11Z,use_quota=True,user_id='da91f1b2fd1844b0b13f2493251e03c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1761ec0-cb53-4083-800a-757ab3581f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1761ec0-cb53-4083-800a-757ab3581f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1704d752-06ea-4a62-a72a-91917e4e37fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1704d752-06ea-4a62-a72a-91917e4e37fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5', 'volume_name': 'volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d1991c-2e4c-4a9f-bb4a-755c2212c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d1991c-2e4c-4a9f-bb4a-755c2212c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba7b226-8fd8-45e6-a2e4-5d1a0991af21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Volume fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5', 'volume_size': 1} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-996315451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9aecbefd1734c109dfc145e40d7d90f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:11Z,use_quota=True,user_id='da91f1b2fd1844b0b13f2493251e03c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Creating volume fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:43:11 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:11 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 1073741824 Jul 10 06:43:11 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:11 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:43:11 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:12 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-515f66ba-2145-49df-9d03-4e1a474b9263" returned: 0 in 1.576s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Lock "cinder-quobyte-515f66ba-2145-49df-9d03-4e1a474b9263" released by "delete_volume" :: held 3.019s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Created reservations ['1ccf6112-d400-4c5c-94bf-163d6bb8b39c', '818ea6d3-02e8-4c81-a0bc-dd9e76677871', 'ce8c1f4e-8510-41c8-a087-0f6188ad94b0', '90128d1a-46ff-4394-a005-a98bab1af6c7'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:12 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:43:12 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Acquiring lock "cinder-61e92923-9d49-4918-8849-ec7bcf4c5d40-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Lock "cinder-61e92923-9d49-4918-8849-ec7bcf4c5d40-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Acquiring lock "cinder-quobyte-61e92923-9d49-4918-8849-ec7bcf4c5d40" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Lock "cinder-quobyte-61e92923-9d49-4918-8849-ec7bcf4c5d40" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:13 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedc27c1-0026-4c54-88a4-6c0547499472]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:13 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.714s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:13 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:13 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:43:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 8 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:43:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:43:13 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40 Jul 10 06:43:13 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:13 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 1073741824" returned: 0 in 2.204s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:13 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 Jul 10 06:43:13 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:14 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.720s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Deleted volume successfully. Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0afba849-1260-4e90-8882-b724fa835cfe tempest-ServersNegativeTestJSON-1816411984 None] Lock "cinder-515f66ba-2145-49df-9d03-4e1a474b9263-delete_volume" released by "delete_volume" :: held 5.203s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:14 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40" returned: 0 in 1.528s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:14 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40 Jul 10 06:43:14 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:14 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5" returned: 0 in 1.084s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] <== create_volume: return (3399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.404s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eba7b226-8fd8-45e6-a2e4-5d1a0991af21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8520515-124d-4c67-ae49-956672d70218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Volume volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 (fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5): created successfully Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8520515-124d-4c67-ae49-956672d70218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Flow 'volume_create_manager' (438d7714-dff5-4023-82aa-50ac605881a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-5b38e6a2-e500-4280-89ed-497834b1f2e6 req-0211016c-aed1-49aa-86f3-4ec428d8154a tempest-VolumesSnapshotsTestJSON-951471373 None] Created volume successfully. Jul 10 06:43:15 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-61e92923-9d49-4918-8849-ec7bcf4c5d40" returned: 0 in 0.664s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Lock "cinder-quobyte-61e92923-9d49-4918-8849-ec7bcf4c5d40" released by "delete_volume" :: held 2.288s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Created reservations ['c638c918-9816-432b-96d5-1fbf64a1da36', '16f17f2d-5f10-4718-aab3-d44d4e5bc299', '7a6b3c43-9c1e-41c1-8dd2-d683c4a023ce', '60935cca-20bd-469b-ad08-74e290834b4e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:15 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:43:15 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] Creating offline snapshot 008aad5f-c028-4054-a3a9-2ef40ede2bc7 of volume fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:43:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b794987a-2dd8-47e2-aa07-061e2957fa6b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:16 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.723s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:16 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Deleted volume successfully. Jul 10 06:43:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9b7e8e48-6f52-4618-807e-37f7de283e76 tempest-ServersNegativeTestJSON-1816411984 None] Lock "cinder-61e92923-9d49-4918-8849-ec7bcf4c5d40-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:16 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 Jul 10 06:43:16 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:16 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5" returned: 0 in 0.840s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:16 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 1G Jul 10 06:43:16 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:17 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 1G" returned: 0 in 0.792s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:17 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 Jul 10 06:43:17 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:18 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7" returned: 0 in 0.923s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:18 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 is being set with open permissions: ugo+rw Jul 10 06:43:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:18 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 Jul 10 06:43:18 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:19 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7" returned: 0 in 0.931s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:19 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.info Jul 10 06:43:19 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:20 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.info" returned: 0 in 0.765s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:20 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.info is being set with open permissions: ugo+rw Jul 10 06:43:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:20 devstack sudo[91885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.info Jul 10 06:43:20 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:21 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.info" returned: 0 in 0.683s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.093s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-f99ac6b3-328f-41ab-a255-0430669c9de5 req-bb856b67-c903-491b-99c9-f41133152d87 tempest-VolumesSnapshotsTestJSON-951471373 None] Create snapshot completed successfully Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Acquiring lock "cinder-008aad5f-c028-4054-a3a9-2ef40ede2bc7-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "cinder-008aad5f-c028-4054-a3a9-2ef40ede2bc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Acquiring lock "cinder-quobyte-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "cinder-quobyte-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Acquiring lock "cinder-quobyte-008aad5f-c028-4054-a3a9-2ef40ede2bc7" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "cinder-quobyte-008aad5f-c028-4054-a3a9-2ef40ede2bc7" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Deleting offline snapshot 008aad5f-c028-4054-a3a9-2ef40ede2bc7 of volume fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] snapshot_file for this snap is: volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[354a4a26-8a08-4397-8aa6-4dc9623dcdb0]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:22 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 Jul 10 06:43:22 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:22 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7" returned: 0 in 1.072s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f2297a-5707-415a-90bd-3d0c2e327fc9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:23 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 Jul 10 06:43:23 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:24 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5" returned: 0 in 1.241s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:24 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 Jul 10 06:43:24 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:25 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7" returned: 0 in 1.086s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:25 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7 Jul 10 06:43:25 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:26 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5.008aad5f-c028-4054-a3a9-2ef40ede2bc7" returned: 0 in 0.834s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:26 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=40,cinder:SELECT=46,cinder:DELETE=6,cinder:INSERT=11 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:43:26 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=47,cinder:UPDATE=45,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:43:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "cinder-quobyte-008aad5f-c028-4054-a3a9-2ef40ede2bc7" released by "_delete_snapshot" :: held 4.448s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "cinder-quobyte-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5" released by "delete_snapshot" :: held 4.519s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:26 devstack cinder-volume[86966]: WARNING cinder.quota [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:43:26 devstack cinder-volume[86966]: DEBUG cinder.quota [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Created reservations ['5073e044-57b7-4fe4-90cc-9ccb1440c90d', 'e9c0927a-9e86-41f8-92b2-f5ea14241a2a', 'b5563726-4682-428a-8abd-9f758bc3096c', '311fab11-3c1d-417e-9515-361169722fca'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Delete snapshot completed successfully. Jul 10 06:43:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4c1cf048-d155-4a5a-83ca-aa28f8ee7979 req-0b3bc27e-417d-4529-a763-935b0221b609 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "cinder-008aad5f-c028-4054-a3a9-2ef40ede2bc7-delete_snapshot" released by "delete_snapshot" :: held 4.747s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Acquiring lock "cinder-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "cinder-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Acquiring lock "cinder-quobyte-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "cinder-quobyte-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c77a37-ce6c-4bf7-920a-623c026bd31a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:27 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 Jul 10 06:43:27 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:28 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5" returned: 0 in 0.877s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:28 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5 Jul 10 06:43:28 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-9df28219-5b71-426d-b8f5-10ddcbb526c7 req-4e100ee3-f33f-4ec1-8fd0-d1df591aa16f tempest-ServerActionsTestOtherA-298552737 None] Terminate volume connection completed successfully. Jul 10 06:43:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-9df28219-5b71-426d-b8f5-10ddcbb526c7 req-4e100ee3-f33f-4ec1-8fd0-d1df591aa16f tempest-ServerActionsTestOtherA-298552737 None] Deleting attachment de4fa355-4a10-4f4a-93b3-ca6081814650. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:43:29 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5" returned: 0 in 1.090s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "cinder-quobyte-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5" released by "delete_volume" :: held 2.055s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:29 devstack cinder-volume[86966]: DEBUG cinder.quota [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Created reservations ['dfa23d07-9594-4857-ac46-e9a6515cf34f', 'eddc0822-7510-42f7-b165-eaec1292c121', 'b2ec2831-7362-4311-a75b-bf7a02d378bb', 'a1c0e831-d629-48f2-97ab-5a71c005d1d1'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:29 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:43:29 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:30 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.036s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:30 devstack cinder-volume[86966]: DEBUG cinder.manager [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Deleted volume successfully. Jul 10 06:43:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-6426bcf6-f78a-4c4e-a77b-31aa5f0eb036 req-fb5a32a1-0ff6-493f-88d7-4f8751100222 tempest-VolumesSnapshotsTestJSON-951471373 None] Lock "cinder-fe59d74a-1f19-4c9a-9abc-aa5424c4a5c5-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Flow 'volume_create_manager' (7a09fc2d-0a1c-4beb-8550-b72c045f1e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02033e03-747e-4edc-b66a-9a6f5cdf80bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02033e03-747e-4edc-b66a-9a6f5cdf80bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1052497490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75667329-eaea-410c-91ca-1fe241d00042,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f71aa20ca1944a54a93e69c9b7bb950f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:36Z,use_quota=True,user_id='1ec9e862823e45c0a9dbf0d102a6dce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1aea137-7e98-49b6-bb47-4b49919f71c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1aea137-7e98-49b6-bb47-4b49919f71c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e5e441-6c05-4bf3-a1c8-528490689f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e5e441-6c05-4bf3-a1c8-528490689f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75667329-eaea-410c-91ca-1fe241d00042', 'volume_name': 'volume-75667329-eaea-410c-91ca-1fe241d00042', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7766b6-ab17-4e07-b84d-3ebe5d64dcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7766b6-ab17-4e07-b84d-3ebe5d64dcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990a5ff1-5271-4ca6-8d2f-736c7f02c78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:36 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Volume 75667329-eaea-410c-91ca-1fe241d00042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75667329-eaea-410c-91ca-1fe241d00042', 'volume_size': 1} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1052497490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75667329-eaea-410c-91ca-1fe241d00042,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f71aa20ca1944a54a93e69c9b7bb950f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:36Z,use_quota=True,user_id='1ec9e862823e45c0a9dbf0d102a6dce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Creating volume 75667329-eaea-410c-91ca-1fe241d00042 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:43:36 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:43:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:36 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042 1073741824 Jul 10 06:43:36 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:37 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042 1073741824" returned: 0 in 0.872s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:37 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042 Jul 10 06:43:37 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:38 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042" returned: 0 in 0.715s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990a5ff1-5271-4ca6-8d2f-736c7f02c78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75667329-eaea-410c-91ca-1fe241d00042', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4c066b-727d-43b9-a889-e616a5a3a564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:38 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Volume volume-75667329-eaea-410c-91ca-1fe241d00042 (75667329-eaea-410c-91ca-1fe241d00042): created successfully Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4c066b-727d-43b9-a889-e616a5a3a564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Flow 'volume_create_manager' (7a09fc2d-0a1c-4beb-8550-b72c045f1e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-c329365e-a15d-4019-8858-4d1b25020b6c req-40352408-f9c8-46ce-8a57-d89e2c7ca175 tempest-VolumesGetTestJSON-1030077519 None] Created volume successfully. Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Acquiring lock "cinder-75667329-eaea-410c-91ca-1fe241d00042-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Lock "cinder-75667329-eaea-410c-91ca-1fe241d00042-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Acquiring lock "cinder-quobyte-75667329-eaea-410c-91ca-1fe241d00042" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Lock "cinder-quobyte-75667329-eaea-410c-91ca-1fe241d00042" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe548f8f-a889-4860-b89a-af2168a43c6c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:39 devstack sudo[91995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042 Jul 10 06:43:39 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:40 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042" returned: 0 in 1.237s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:40 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042 Jul 10 06:43:40 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Acquiring lock "cinder-3509b916-dd4b-4bdd-992f-d162d21a14ea-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Lock "cinder-3509b916-dd4b-4bdd-992f-d162d21a14ea-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Acquiring lock "cinder-quobyte-3509b916-dd4b-4bdd-992f-d162d21a14ea" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Lock "cinder-quobyte-3509b916-dd4b-4bdd-992f-d162d21a14ea" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:40 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2bcee5-4b46-46d8-aadb-2067d6144b27]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:40 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea Jul 10 06:43:40 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:41 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea" returned: 0 in 1.039s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:41 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea Jul 10 06:43:41 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:41 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-75667329-eaea-410c-91ca-1fe241d00042" returned: 0 in 1.282s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Lock "cinder-quobyte-75667329-eaea-410c-91ca-1fe241d00042" released by "delete_volume" :: held 2.584s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:41 devstack cinder-volume[86966]: DEBUG cinder.quota [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Created reservations ['2e7d9346-d1de-41a3-852f-928c8f86bb38', 'c674ad16-67df-4836-b5a8-eedba5969344', '6ca5c323-c119-48ee-ad90-ebaf62f83e02', '5617af06-7eda-4a03-9c8b-3ff0fa1c4756'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:41 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:43:41 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:42 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3509b916-dd4b-4bdd-992f-d162d21a14ea" returned: 0 in 0.971s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Lock "cinder-quobyte-3509b916-dd4b-4bdd-992f-d162d21a14ea" released by "delete_volume" :: held 2.085s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Created reservations ['69a7a0cd-148d-4703-a4e7-3a1116916e30', '4e175abf-4850-4550-a401-561754544faa', 'c583f3d6-1557-43b8-8a6d-72380583a487', 'd59b057f-3587-4712-952b-cb82a3315092'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:42 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:43:42 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:42 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.003s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG cinder.manager [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Deleted volume successfully. Jul 10 06:43:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-9828363d-2163-4858-8688-1a3c7150a1db req-db98f3f4-8bdb-41a9-9de0-3c72dbe73e45 tempest-VolumesGetTestJSON-1030077519 None] Lock "cinder-75667329-eaea-410c-91ca-1fe241d00042-delete_volume" released by "delete_volume" :: held 3.884s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:43 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.896s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:43 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Deleted volume successfully. Jul 10 06:43:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ec28398-1ec0-4609-ae6e-b10d91ba4da8 tempest-ServerActionsTestOtherA-298552737 None] Lock "cinder-3509b916-dd4b-4bdd-992f-d162d21a14ea-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Flow 'volume_create_manager' (3885a49e-4c9d-432e-b4ed-d1de446c80b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be845a4-0d82-488f-bc45-2b3f624bc7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1be845a4-0d82-488f-bc45-2b3f624bc7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1007231494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db211d6-05b5-438e-aa4c-1e14105bc113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab983faa3c0461c9deb3771e1869874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:46Z,use_quota=True,user_id='6acbd44d162b4d2c8d736609b1db0a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6eced5-8a89-41e9-95f9-f40dcd2dbac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6eced5-8a89-41e9-95f9-f40dcd2dbac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8ae984-1ad6-436b-a845-0433ac6811a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8ae984-1ad6-436b-a845-0433ac6811a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1db211d6-05b5-438e-aa4c-1e14105bc113', 'volume_name': 'volume-1db211d6-05b5-438e-aa4c-1e14105bc113', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f48c66-3d29-48d3-9593-2659c9c25a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f48c66-3d29-48d3-9593-2659c9c25a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe5a9ca-9976-44e1-b961-1d53575f032c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Volume 1db211d6-05b5-438e-aa4c-1e14105bc113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1db211d6-05b5-438e-aa4c-1e14105bc113', 'volume_size': 1} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1007231494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db211d6-05b5-438e-aa4c-1e14105bc113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab983faa3c0461c9deb3771e1869874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:46Z,use_quota=True,user_id='6acbd44d162b4d2c8d736609b1db0a17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Creating volume 1db211d6-05b5-438e-aa4c-1e14105bc113 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:43:46 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:43:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:46 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113 1073741824 Jul 10 06:43:46 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:47 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113 1073741824" returned: 0 in 1.275s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:47 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113 Jul 10 06:43:47 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:48 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113" returned: 0 in 0.915s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:43:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.248s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe5a9ca-9976-44e1-b961-1d53575f032c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db211d6-05b5-438e-aa4c-1e14105bc113', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a506935-7ff3-4a12-879d-4949d95aea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Volume volume-1db211d6-05b5-438e-aa4c-1e14105bc113 (1db211d6-05b5-438e-aa4c-1e14105bc113): created successfully Jul 10 06:43:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a506935-7ff3-4a12-879d-4949d95aea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Flow 'volume_create_manager' (3885a49e-4c9d-432e-b4ed-d1de446c80b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b8c8695a-e019-4afc-86a5-dc455590db61 tempest-AttachVolumeNegativeTest-1558798489 None] Created volume successfully. Jul 10 06:43:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b664a108-5fcc-4a83-8b79-7e74d58e66ea tempest-BackendsCapabilitiesAdminTestsJSON-1000798682 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540664672852, 'free_capacity_gb': 1775.7540664672852, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86966) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 06:43:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2fcd3f9f-d226-43ae-b7c8-0a707852347b tempest-BackendsCapabilitiesAdminTestsJSON-1000798682 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540664672852, 'free_capacity_gb': 1775.7540664672852, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86966) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 06:43:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-dadb2d12-04dc-4b15-912d-cc3f7c99365f req-a6e765ed-3584-4f92-96e1-8522f60fd74e tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-dadb2d12-04dc-4b15-912d-cc3f7c99365f req-a6e765ed-3584-4f92-96e1-8522f60fd74e tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:52 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5650179-6586-45a4-86f5-40496130e4a6]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-dadb2d12-04dc-4b15-912d-cc3f7c99365f req-a6e765ed-3584-4f92-96e1-8522f60fd74e tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:52 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113 Jul 10 06:43:52 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:53 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-dadb2d12-04dc-4b15-912d-cc3f7c99365f req-a6e765ed-3584-4f92-96e1-8522f60fd74e tempest-AttachVolumeNegativeTest-1558798489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113" returned: 0 in 0.966s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-dadb2d12-04dc-4b15-912d-cc3f7c99365f req-a6e765ed-3584-4f92-96e1-8522f60fd74e tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.985s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-dadb2d12-04dc-4b15-912d-cc3f7c99365f req-a6e765ed-3584-4f92-96e1-8522f60fd74e tempest-AttachVolumeNegativeTest-1558798489 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-1db211d6-05b5-438e-aa4c-1e14105bc113', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96ba8df4-2995-4074-9575-0eed390777d7', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:43:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-dadb2d12-04dc-4b15-912d-cc3f7c99365f req-a6e765ed-3584-4f92-96e1-8522f60fd74e tempest-AttachVolumeNegativeTest-1558798489 None] attachment_update completed successfully. Jul 10 06:44:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-e77bbace-663c-4f7b-b03d-8afbc5395e64 req-fba6caf4-6b67-4fd5-859a-ca35e42b182f tempest-AttachVolumeNegativeTest-1558798489 None] Terminate volume connection completed successfully. Jul 10 06:44:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-e77bbace-663c-4f7b-b03d-8afbc5395e64 req-fba6caf4-6b67-4fd5-859a-ca35e42b182f tempest-AttachVolumeNegativeTest-1558798489 None] Deleting attachment 96ba8df4-2995-4074-9575-0eed390777d7. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:44:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-14c93e7f-c023-420c-a479-83bcfbef4ec8 tempest-GroupsV314Test-724828173 None] Group tempest-GroupsV314Test-Group-582684212: creating Jul 10 06:44:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-14c93e7f-c023-420c-a479-83bcfbef4ec8 tempest-GroupsV314Test-724828173 None] Group tempest-GroupsV314Test-Group-582684212: created successfully Jul 10 06:44:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-14c93e7f-c023-420c-a479-83bcfbef4ec8 tempest-GroupsV314Test-724828173 None] Create group completed successfully. Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Flow 'volume_create_manager' (c3c9512c-6138-490e-ac53-4f044fcbaaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5f0994-8e30-42d4-b06b-1a624d256247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5f0994-8e30-42d4-b06b-1a624d256247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-392374181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0834e8d-e810-40bb-ace8-032c4b0f7793,host='devstack@QuobyteHD#QuobyteHD',id=fc7aa9db-a828-421f-9847-b2faaaa38fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b95acc8bc7c645509ca6dcb309222df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:04Z,use_quota=True,user_id='a512515fbc1847af947aec06de17a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83bc2849-15a7-4f0e-8cac-b662f206fe87),volume_type_id=83bc2849-15a7-4f0e-8cac-b662f206fe87)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee15563-6f79-4acb-a434-bd00184d4c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ee15563-6f79-4acb-a434-bd00184d4c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2897a73d-191e-4a42-88cc-41cdb0eaa03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2897a73d-191e-4a42-88cc-41cdb0eaa03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc7aa9db-a828-421f-9847-b2faaaa38fb1', 'volume_name': 'volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618d6474-9a46-44e4-81e7-9bca13072a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618d6474-9a46-44e4-81e7-9bca13072a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458a990f-e386-487f-b093-931682c1da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Volume fc7aa9db-a828-421f-9847-b2faaaa38fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1', 'volume_size': 1} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c0834e8d-e810-40bb-ace8-032c4b0f7793,created_at=2026-07-10T04:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-392374181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c0834e8d-e810-40bb-ace8-032c4b0f7793,host='devstack@QuobyteHD#QuobyteHD',id=fc7aa9db-a828-421f-9847-b2faaaa38fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b95acc8bc7c645509ca6dcb309222df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:04Z,use_quota=True,user_id='a512515fbc1847af947aec06de17a8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83bc2849-15a7-4f0e-8cac-b662f206fe87),volume_type_id=83bc2849-15a7-4f0e-8cac-b662f206fe87)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Creating volume fc7aa9db-a828-421f-9847-b2faaaa38fb1 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:04 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:44:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:04 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 1073741824 Jul 10 06:44:04 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:05 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 1073741824" returned: 0 in 1.510s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:05 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 Jul 10 06:44:05 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:07 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1" returned: 0 in 1.457s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] <== create_volume: return (3074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.081s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458a990f-e386-487f-b093-931682c1da00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75d60ba-b5e2-4b82-bfd5-2bc48ba53bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Volume volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 (fc7aa9db-a828-421f-9847-b2faaaa38fb1): created successfully Jul 10 06:44:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75d60ba-b5e2-4b82-bfd5-2bc48ba53bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Flow 'volume_create_manager' (c3c9512c-6138-490e-ac53-4f044fcbaaa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1fc479f8-a096-48b4-a5a3-8736e71326bf tempest-GroupsV314Test-724828173 None] Created volume successfully. Jul 10 06:44:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:09 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Cloning volume fc7aa9db-a828-421f-9847-b2faaaa38fb1 to volume 4b6b5f7d-f454-4e90-8342-d947b705fb28 Jul 10 06:44:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Creating offline snapshot e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf of volume fc7aa9db-a828-421f-9847-b2faaaa38fb1 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:44:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dd5d57-bb67-4996-bee3-b18e6a9e4250]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:09 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 Jul 10 06:44:09 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:11 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1" returned: 0 in 1.467s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:11 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf 1G Jul 10 06:44:11 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:44:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:11 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:11 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "cinder-1db211d6-05b5-438e-aa4c-1e14105bc113-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-1db211d6-05b5-438e-aa4c-1e14105bc113-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "cinder-quobyte-1db211d6-05b5-438e-aa4c-1e14105bc113" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-quobyte-1db211d6-05b5-438e-aa4c-1e14105bc113" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c3001e-69e5-42c6-a96b-552e44c83af0]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:12 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf 1G" returned: 0 in 1.919s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:13 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf Jul 10 06:44:13 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:13 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.704s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:13 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:13 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:44:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 8 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:44:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:44:13 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113 Jul 10 06:44:13 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:13 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf" returned: 0 in 0.990s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:13 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:44:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:14 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf Jul 10 06:44:14 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:14 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113" returned: 0 in 1.150s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:14 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113 Jul 10 06:44:14 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:14 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf" returned: 0 in 0.852s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:14 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.info Jul 10 06:44:14 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:14 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1db211d6-05b5-438e-aa4c-1e14105bc113" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-quobyte-1db211d6-05b5-438e-aa4c-1e14105bc113" released by "delete_volume" :: held 2.101s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:15 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Created reservations ['c0d8fa35-985f-4c01-9615-40691126b5b8', 'e616cd69-7524-424b-b332-f9a4793d2e72', '05b37e87-7b44-46dc-8572-aa829b17e0f8', '7a2c46b7-d784-42e7-9323-458aec86b205'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:15 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:15 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:15 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.info" returned: 0 in 0.923s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:15 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:44:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:15 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.info Jul 10 06:44:15 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:15 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.717s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Deleted volume successfully. Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-59de4933-5311-4790-a014-64cedb69cc47 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-1db211d6-05b5-438e-aa4c-1e14105bc113-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "cinder-f28cfbfa-ae11-48b1-8951-cb27dffbd60c-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-f28cfbfa-ae11-48b1-8951-cb27dffbd60c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "cinder-quobyte-f28cfbfa-ae11-48b1-8951-cb27dffbd60c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-quobyte-f28cfbfa-ae11-48b1-8951-cb27dffbd60c" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e1f22a-5434-4d42-9945-9d20b26f6eef]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:16 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.info" returned: 0 in 0.832s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Acquiring lock "cinder-quobyte-4b6b5f7d-f454-4e90-8342-d947b705fb28" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Lock "cinder-quobyte-4b6b5f7d-f454-4e90-8342-d947b705fb28" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] snapshot: e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf, volume: 4b6b5f7d-f454-4e90-8342-d947b705fb28, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:44:16 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c Jul 10 06:44:16 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a3d18-685c-48d9-8092-83d8d894a588]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:16 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf Jul 10 06:44:16 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:17 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c" returned: 0 in 1.055s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:17 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c Jul 10 06:44:17 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:17 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf" returned: 0 in 1.114s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:44:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:44:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:44:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40bee5a-bf3f-411f-9c9b-d327b2c1750f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:17 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 Jul 10 06:44:18 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f28cfbfa-ae11-48b1-8951-cb27dffbd60c" returned: 0 in 0.797s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:18 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-quobyte-f28cfbfa-ae11-48b1-8951-cb27dffbd60c" released by "delete_volume" :: held 1.903s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Created reservations ['28159a8c-c406-4efb-a845-f57b4e08e1cc', '67a251bb-bd05-4ddd-8664-367f621539e6', 'bfac8c18-c8bd-4b9d-8c8e-78b18f55e6e0', 'c639a15b-83ec-4486-b1b4-39f304959d27'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:18 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:18 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:18 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Flow 'volume_create_manager' (0406662f-e772-4910-8c1e-6a84d6d0a817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147fea14-f6de-4df2-bfeb-7e99950a225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1" returned: 0 in 0.871s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147fea14-f6de-4df2-bfeb-7e99950a225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2053217480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a295db-aa11-4ad2-901e-12e7eccfaa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d59eb653eb449587658712ca8131f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:19Z,use_quota=True,user_id='4e6af72fa5b54f07bf2e69791f897117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:18 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28 Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e95d285-8f62-4573-8db5-7ecf0fe6ac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:18 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e95d285-8f62-4573-8db5-7ecf0fe6ac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb557ea-41cf-4ed1-a62f-6579bfa89e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb557ea-41cf-4ed1-a62f-6579bfa89e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a295db-aa11-4ad2-901e-12e7eccfaa59', 'volume_name': 'volume-27a295db-aa11-4ad2-901e-12e7eccfaa59', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d746bdf0-0229-4aa1-9340-251fede3937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d746bdf0-0229-4aa1-9340-251fede3937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9312c5a-6e72-45ef-8472-c8fc046878a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Volume 27a295db-aa11-4ad2-901e-12e7eccfaa59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a295db-aa11-4ad2-901e-12e7eccfaa59', 'volume_size': 1} Jul 10 06:44:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "cinder-0982f5a0-1940-458f-8c11-8983782b30fa-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-0982f5a0-1940-458f-8c11-8983782b30fa-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "cinder-quobyte-0982f5a0-1940-458f-8c11-8983782b30fa" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-quobyte-0982f5a0-1940-458f-8c11-8983782b30fa" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef98f2-267c-480c-a7bd-6b06cf2cd3b0]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:19 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa Jul 10 06:44:19 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:19 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.695s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:19 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Deleted volume successfully. Jul 10 06:44:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-03797bbd-a8ef-41f7-b40e-d7fec528375f tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-f28cfbfa-ae11-48b1-8951-cb27dffbd60c-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:20 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa" returned: 0 in 1.115s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:20 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa Jul 10 06:44:20 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:21 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0982f5a0-1940-458f-8c11-8983782b30fa" returned: 0 in 1.454s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-quobyte-0982f5a0-1940-458f-8c11-8983782b30fa" released by "delete_volume" :: held 2.640s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:21 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Created reservations ['892ce2a9-9c83-445d-974f-68252562877d', 'b7b8b211-1ad2-4c39-bdf9-6219a4e0d593', '3d0eccfe-f86d-4a21-b57b-6df93b4fe9a2', '13b0927b-7230-41eb-a1e5-4bb8babf4dda'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:22 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:22 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:23 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.195s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:23 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Deleted volume successfully. Jul 10 06:44:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7e67b321-379d-4a7d-a0f2-147f0abddb88 tempest-AttachVolumeNegativeTest-1558798489 None] Lock "cinder-0982f5a0-1940-458f-8c11-8983782b30fa-delete_volume" released by "delete_volume" :: held 4.231s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:24 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28" returned: 0 in 5.640s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:24 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9d7ac5-ae81-4963-af06-bf9000d1aaa6]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:24 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 Jul 10 06:44:24 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:25 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1" returned: 0 in 1.055s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:25 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:44:25 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Converted 1024.00 MB image at 181.53 MB/s Jul 10 06:44:25 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:44:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:25 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28 Jul 10 06:44:25 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:26 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28" returned: 0 in 0.707s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Lock "cinder-quobyte-4b6b5f7d-f454-4e90-8342-d947b705fb28" released by "_copy_volume_from_snapshot" :: held 9.483s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Acquiring lock "cinder-quobyte-e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Lock "cinder-quobyte-e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Deleting offline snapshot e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf of volume fc7aa9db-a828-421f-9847-b2faaaa38fb1 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:44:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] snapshot_file for this snap is: volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:44:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d29f556-f8ac-47ee-aa7b-5f427830f013]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:26 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf Jul 10 06:44:26 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:27 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf" returned: 0 in 0.954s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:44:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf68f6a-a6d9-433a-a98b-2b1d91520597]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:27 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 Jul 10 06:44:27 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:28 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1" returned: 0 in 0.847s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:28 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf Jul 10 06:44:28 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:28 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf" returned: 0 in 0.876s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:29 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf Jul 10 06:44:29 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=48,cinder:INSERT=18,cinder:UPDATE=73,cinder:DELETE=5 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=65,cinder:UPDATE=61,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Flow 'volume_create_manager' (485352b8-ae87-4460-b715-256103e37a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9b19dc-be47-4e56-b1c1-8ad2212a1ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9b19dc-be47-4e56-b1c1-8ad2212a1ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-460825478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329b3d7f-c326-439f-a93a-a4f700a2b019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b5e736065d4e9195594004b27eca58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:29Z,use_quota=True,user_id='88c8979ca5fe44648378ea389a02988f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f43926-ab3a-4210-9d15-9502ef160826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f43926-ab3a-4210-9d15-9502ef160826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a50dc8-b51b-4f36-8b31-356fd1549360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a50dc8-b51b-4f36-8b31-356fd1549360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329b3d7f-c326-439f-a93a-a4f700a2b019', 'volume_name': 'volume-329b3d7f-c326-439f-a93a-a4f700a2b019', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137e06d4-f680-4434-abbb-4725607aaba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137e06d4-f680-4434-abbb-4725607aaba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cec1fdc-2f66-4c05-8d9b-d29f50df760a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Volume 329b3d7f-c326-439f-a93a-a4f700a2b019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329b3d7f-c326-439f-a93a-a4f700a2b019', 'volume_size': 1} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:29 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1.e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf" returned: 0 in 0.723s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Lock "cinder-quobyte-e5fb6a15-2cb3-45c2-a3d3-f2ce620498bf" released by "_delete_snapshot" :: held 3.532s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.271s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.934s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2053217480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a295db-aa11-4ad2-901e-12e7eccfaa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d59eb653eb449587658712ca8131f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:19Z,use_quota=True,user_id='4e6af72fa5b54f07bf2e69791f897117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Creating volume 27a295db-aa11-4ad2-901e-12e7eccfaa59 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:29 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:44:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:29 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59 1073741824 Jul 10 06:44:29 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-76c407a4-614b-431c-ad0e-685074807013 tempest-GroupsV314Test-724828173 None] Create group from source-group-c0834e8d-e810-40bb-ace8-032c4b0f7793 completed successfully. Jul 10 06:44:30 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59 1073741824" returned: 0 in 0.926s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:30 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59 Jul 10 06:44:30 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Acquiring lock "cinder-quobyte-4b6b5f7d-f454-4e90-8342-d947b705fb28" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Lock "cinder-quobyte-4b6b5f7d-f454-4e90-8342-d947b705fb28" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:30 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62737d1-c83a-4a50-9093-c4bf576a8d1c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:31 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28 Jul 10 06:44:31 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Flow 'volume_create_manager' (5e4671ee-56e8-401f-80a8-53f63a3f9a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ed6ca1-9f25-4013-a8dc-f8f9df8108da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ed6ca1-9f25-4013-a8dc-f8f9df8108da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1712741278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096fb5cd-7362-4fb2-8a1a-5e71e83d7741,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e5e43a3c22e145589a3b68cbac3baeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:31Z,use_quota=True,user_id='8a80dd2f61ee4706ba43ee92ae9e35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b70337-7008-41f7-a098-c5975a63cc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b70337-7008-41f7-a098-c5975a63cc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87da9e3c-980c-44f8-875e-f5daf562fbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87da9e3c-980c-44f8-875e-f5daf562fbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '096fb5cd-7362-4fb2-8a1a-5e71e83d7741', 'volume_name': 'volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3f66de-9c39-4d72-b9e4-992475084783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3f66de-9c39-4d72-b9e4-992475084783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f55080-cf29-4eb8-8761-37f0f5babea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:31 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Volume 096fb5cd-7362-4fb2-8a1a-5e71e83d7741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741', 'volume_size': 1} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:31 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.966s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-460825478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329b3d7f-c326-439f-a93a-a4f700a2b019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1b5e736065d4e9195594004b27eca58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:29Z,use_quota=True,user_id='88c8979ca5fe44648378ea389a02988f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Creating volume 329b3d7f-c326-439f-a93a-a4f700a2b019 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:31 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:31 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019 1073741824 Jul 10 06:44:31 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9312c5a-6e72-45ef-8472-c8fc046878a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a295db-aa11-4ad2-901e-12e7eccfaa59', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180f16a9-59fa-4121-a73e-7ddec116db9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:31 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Volume volume-27a295db-aa11-4ad2-901e-12e7eccfaa59 (27a295db-aa11-4ad2-901e-12e7eccfaa59): created successfully Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180f16a9-59fa-4121-a73e-7ddec116db9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Flow 'volume_create_manager' (0406662f-e772-4910-8c1e-6a84d6d0a817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-13a764e3-a69f-486a-9958-b0bf744d5651 tempest-VolumeQuotasAdminTestJSON-930885661 None] Created volume successfully. Jul 10 06:44:31 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28" returned: 0 in 0.851s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:31 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28 Jul 10 06:44:31 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Acquiring lock "cinder-27a295db-aa11-4ad2-901e-12e7eccfaa59-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "cinder-27a295db-aa11-4ad2-901e-12e7eccfaa59-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Acquiring lock "cinder-quobyte-27a295db-aa11-4ad2-901e-12e7eccfaa59" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "cinder-quobyte-27a295db-aa11-4ad2-901e-12e7eccfaa59" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f51b0c5-4250-4aee-8427-6c0e66bc4368]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:32 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59 Jul 10 06:44:32 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:32 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019 1073741824" returned: 0 in 0.936s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:32 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4b6b5f7d-f454-4e90-8342-d947b705fb28" returned: 0 in 0.767s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Lock "cinder-quobyte-4b6b5f7d-f454-4e90-8342-d947b705fb28" released by "delete_volume" :: held 1.694s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:32 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019 Jul 10 06:44:32 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Created reservations ['92f318a8-3e07-4fc2-82d8-4de42fbc6d6f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:32 devstack cinder-volume[86966]: WARNING cinder.quota [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-425936639 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-425936639, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:44:32 devstack cinder-volume[86966]: WARNING cinder.quota [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-425936639 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-425936639, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Created reservations ['e9c251ff-2e74-4c02-b8b4-eec6dd169481', 'ae180e5c-1010-4b6f-b0c8-cff747951b96', 'ca3bc07e-4a83-41f8-b7ca-ef82eb0093e4', '00af950b-ca5d-4c6d-b137-655a5517c0dd'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:32 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59" returned: 0 in 0.800s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:32 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59 Jul 10 06:44:32 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:32 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:32 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:33 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019" returned: 0 in 0.768s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.824s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1712741278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096fb5cd-7362-4fb2-8a1a-5e71e83d7741,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e5e43a3c22e145589a3b68cbac3baeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:31Z,use_quota=True,user_id='8a80dd2f61ee4706ba43ee92ae9e35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Creating volume 096fb5cd-7362-4fb2-8a1a-5e71e83d7741 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:33 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cec1fdc-2f66-4c05-8d9b-d29f50df760a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329b3d7f-c326-439f-a93a-a4f700a2b019', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:33 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741 1073741824 Jul 10 06:44:33 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1004e52-bc8b-4bee-8133-d08c961a7b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Volume volume-329b3d7f-c326-439f-a93a-a4f700a2b019 (329b3d7f-c326-439f-a93a-a4f700a2b019): created successfully Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1004e52-bc8b-4bee-8133-d08c961a7b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Flow 'volume_create_manager' (485352b8-ae87-4460-b715-256103e37a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-36fe70af-a6b0-4e3c-9ffe-e4e070d897fa tempest-AttachVolumeShelveTestJSON-541215019 None] Created volume successfully. Jul 10 06:44:33 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-27a295db-aa11-4ad2-901e-12e7eccfaa59" returned: 0 in 0.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "cinder-quobyte-27a295db-aa11-4ad2-901e-12e7eccfaa59" released by "delete_volume" :: held 1.633s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Created reservations ['6b7714f7-4c8b-4bc4-88a6-2fc922ce33f2', 'c57fa3d8-43ab-42b9-877e-94972f4bcf92', '84ec6d39-adff-4ecf-b82a-ef1c006333ef', '034599de-f19e-426a-941e-44a81c64c81e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:33 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.875s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dee00a38-afa7-44c4-ba97-cd54276b4c06 tempest-GroupsV314Test-724828173 None] Delete group completed successfully. Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Acquiring lock "cinder-quobyte-fc7aa9db-a828-421f-9847-b2faaaa38fb1" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Lock "cinder-quobyte-fc7aa9db-a828-421f-9847-b2faaaa38fb1" acquired by "delete_volume" :: waited 0.036s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7189d3-ec6d-4246-b091-60ae854a2ddf]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:33 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:33 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:33 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 Jul 10 06:44:33 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:34 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741 1073741824" returned: 0 in 1.244s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:34 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741 Jul 10 06:44:34 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Flow 'volume_create_manager' (05d807ee-57a7-47f2-9d31-032ae0c12775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cc92f9-efc7-4d33-8717-37ae6f3c96e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cc92f9-efc7-4d33-8717-37ae6f3c96e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1769166832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd276e71-f89d-46d1-9939-8b28259022e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d59eb653eb449587658712ca8131f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:35Z,use_quota=True,user_id='4e6af72fa5b54f07bf2e69791f897117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c132b30-bb06-4efd-bdec-9341686c2b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c132b30-bb06-4efd-bdec-9341686c2b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8ab070-a819-4103-ae43-75a443951443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8ab070-a819-4103-ae43-75a443951443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd276e71-f89d-46d1-9939-8b28259022e1', 'volume_name': 'volume-dd276e71-f89d-46d1-9939-8b28259022e1', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b87a2b4-d9c9-40cb-91e6-531991eb5c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b87a2b4-d9c9-40cb-91e6-531991eb5c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66263b59-164d-4c9e-8275-1e10883c6204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:34 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Volume dd276e71-f89d-46d1-9939-8b28259022e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd276e71-f89d-46d1-9939-8b28259022e1', 'volume_size': 1} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:34 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.088s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Deleted volume successfully. Jul 10 06:44:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6dad971e-f178-4b76-8336-e6ba6108af4f tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "cinder-27a295db-aa11-4ad2-901e-12e7eccfaa59-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:35 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1" returned: 0 in 1.359s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:35 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1 Jul 10 06:44:35 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:35 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741" returned: 0 in 0.831s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.155s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1769166832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd276e71-f89d-46d1-9939-8b28259022e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d59eb653eb449587658712ca8131f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:35Z,use_quota=True,user_id='4e6af72fa5b54f07bf2e69791f897117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Creating volume dd276e71-f89d-46d1-9939-8b28259022e1 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:35 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f55080-cf29-4eb8-8761-37f0f5babea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca6a20a-2108-4bee-97f0-a932f5119fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:35 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1 1073741824 Jul 10 06:44:35 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Volume volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741 (096fb5cd-7362-4fb2-8a1a-5e71e83d7741): created successfully Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca6a20a-2108-4bee-97f0-a932f5119fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Flow 'volume_create_manager' (5e4671ee-56e8-401f-80a8-53f63a3f9a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c59c6110-7a8e-4e59-8a9d-300e1ada992e tempest-VolumesTestJSON-1632397101 None] Created volume successfully. Jul 10 06:44:35 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fc7aa9db-a828-421f-9847-b2faaaa38fb1" returned: 0 in 0.798s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Lock "cinder-quobyte-fc7aa9db-a828-421f-9847-b2faaaa38fb1" released by "delete_volume" :: held 2.246s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Created reservations ['661baf37-273f-4e68-9a0e-ddb6ec4c0ac0'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Created reservations ['9aa11029-23d8-4bad-b9a0-368e4b7e1770', '2bffe2a2-60d0-4343-b101-381895ab5a15', '3371d412-bc5e-46d5-a96c-7e6b23a502f4', '8e992281-c597-4bdf-ab02-904cbc1d7fa7'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:36 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:36 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Flow 'volume_create_manager' (df13a37a-8c2b-42db-9d99-31bd21b7a874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35060aec-8f92-4fa0-af29-bd7d70cf43de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35060aec-8f92-4fa0-af29-bd7d70cf43de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2102865232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92977499-1426-4336-ab67-68dfcb173b27,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e5e43a3c22e145589a3b68cbac3baeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:36Z,use_quota=True,user_id='8a80dd2f61ee4706ba43ee92ae9e35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe1a00e-607f-4ae7-9859-0e149d9ef98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe1a00e-607f-4ae7-9859-0e149d9ef98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b476a879-3600-4c8b-8076-47c56687e226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b476a879-3600-4c8b-8076-47c56687e226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92977499-1426-4336-ab67-68dfcb173b27', 'volume_name': 'volume-92977499-1426-4336-ab67-68dfcb173b27', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8bac8f-5b4d-4775-8d0b-eef9d011e4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8bac8f-5b4d-4775-8d0b-eef9d011e4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ec12f8-39f9-4bd6-923c-d0e3424e9e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:36 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Volume 92977499-1426-4336-ab67-68dfcb173b27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92977499-1426-4336-ab67-68dfcb173b27', 'volume_size': 1} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:36 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1 1073741824" returned: 0 in 1.093s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:36 devstack sudo[92893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1 Jul 10 06:44:36 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:36 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.712s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-26cdf1f8-eb98-414c-b39f-78c7a36e0fa2 tempest-GroupsV314Test-724828173 None] Delete group completed successfully. Jul 10 06:44:37 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1" returned: 0 in 0.728s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.868s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2102865232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92977499-1426-4336-ab67-68dfcb173b27,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e5e43a3c22e145589a3b68cbac3baeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:36Z,use_quota=True,user_id='8a80dd2f61ee4706ba43ee92ae9e35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Creating volume 92977499-1426-4336-ab67-68dfcb173b27 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:37 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66263b59-164d-4c9e-8275-1e10883c6204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd276e71-f89d-46d1-9939-8b28259022e1', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:37 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27 1073741824 Jul 10 06:44:37 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ce7eb4-2715-42f1-b185-13aabf431ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:37 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Volume volume-dd276e71-f89d-46d1-9939-8b28259022e1 (dd276e71-f89d-46d1-9939-8b28259022e1): created successfully Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ce7eb4-2715-42f1-b185-13aabf431ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Flow 'volume_create_manager' (05d807ee-57a7-47f2-9d31-032ae0c12775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fe61f271-b3db-4c3f-b8c0-7a9f1535dfe5 tempest-VolumeQuotasAdminTestJSON-930885661 None] Created volume successfully. Jul 10 06:44:38 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27 1073741824" returned: 0 in 1.018s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:38 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27 Jul 10 06:44:38 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6e3448c4-9515-47f5-89e2-a90f13a88e37 tempest-VolumeQuotasAdminTestJSON-508926093 None] Transfer volume completed successfully. Jul 10 06:44:39 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ec12f8-39f9-4bd6-923c-d0e3424e9e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92977499-1426-4336-ab67-68dfcb173b27', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493ac076-949e-4276-b2c3-107388a4428d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:39 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Volume volume-92977499-1426-4336-ab67-68dfcb173b27 (92977499-1426-4336-ab67-68dfcb173b27): created successfully Jul 10 06:44:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493ac076-949e-4276-b2c3-107388a4428d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Flow 'volume_create_manager' (df13a37a-8c2b-42db-9d99-31bd21b7a874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fd6f79ac-1124-46a8-9d14-080c5fcb894b tempest-VolumesTestJSON-1632397101 None] Created volume successfully. Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Acquiring lock "cinder-dd276e71-f89d-46d1-9939-8b28259022e1-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Lock "cinder-dd276e71-f89d-46d1-9939-8b28259022e1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Acquiring lock "cinder-quobyte-dd276e71-f89d-46d1-9939-8b28259022e1" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Lock "cinder-quobyte-dd276e71-f89d-46d1-9939-8b28259022e1" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[056adb63-37a5-466b-bbd5-53f84d89457d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:40 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1 Jul 10 06:44:40 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Flow 'volume_create_manager' (9a7d7d9e-69bc-49fd-b181-e6e0d30a7870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d07c60-79f1-4f5f-bbeb-ecc81e938e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d07c60-79f1-4f5f-bbeb-ecc81e938e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1986706255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e893d176-508b-4fef-8381-68b4c67e6766,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e5e43a3c22e145589a3b68cbac3baeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:40Z,use_quota=True,user_id='8a80dd2f61ee4706ba43ee92ae9e35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a372be-ca79-4340-a0d2-e92a6bd342ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a372be-ca79-4340-a0d2-e92a6bd342ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075085ce-ef9d-4538-95ec-78e44cc9fefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075085ce-ef9d-4538-95ec-78e44cc9fefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e893d176-508b-4fef-8381-68b4c67e6766', 'volume_name': 'volume-e893d176-508b-4fef-8381-68b4c67e6766', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c42a77-f403-41c3-aa46-d6252f2479f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c42a77-f403-41c3-aa46-d6252f2479f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2afbc6f-d1e6-4963-ab31-9e29ad091567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Volume e893d176-508b-4fef-8381-68b4c67e6766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e893d176-508b-4fef-8381-68b4c67e6766', 'volume_size': 1} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1986706255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e893d176-508b-4fef-8381-68b4c67e6766,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e5e43a3c22e145589a3b68cbac3baeb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:40Z,use_quota=True,user_id='8a80dd2f61ee4706ba43ee92ae9e35ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Creating volume e893d176-508b-4fef-8381-68b4c67e6766 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:40 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:44:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:40 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766 1073741824 Jul 10 06:44:40 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:41 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1" returned: 0 in 1.166s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:41 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1 Jul 10 06:44:41 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:41 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766 1073741824" returned: 0 in 1.189s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:42 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766 Jul 10 06:44:42 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:42 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-dd276e71-f89d-46d1-9939-8b28259022e1" returned: 0 in 0.757s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Lock "cinder-quobyte-dd276e71-f89d-46d1-9939-8b28259022e1" released by "delete_volume" :: held 2.008s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Created reservations ['a7a538b3-5592-483a-9d1b-6f061c006a69', '8f04b6cc-5f35-46a9-8230-2fe5ae27e507', '9d48cea5-ba39-4ed9-bb7c-afd10c996526', 'acff1e7e-4e32-4a71-a5d3-5267d3af4678'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:42 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:42 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:42 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766" returned: 0 in 0.849s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2afbc6f-d1e6-4963-ab31-9e29ad091567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e893d176-508b-4fef-8381-68b4c67e6766', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c154303-7db5-4dcf-b459-4e8fd373b0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Volume volume-e893d176-508b-4fef-8381-68b4c67e6766 (e893d176-508b-4fef-8381-68b4c67e6766): created successfully Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c154303-7db5-4dcf-b459-4e8fd373b0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Flow 'volume_create_manager' (9a7d7d9e-69bc-49fd-b181-e6e0d30a7870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7f284045-ffd1-47e1-9d4e-4e4a828a58ea tempest-VolumesTestJSON-1632397101 None] Created volume successfully. Jul 10 06:44:43 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.856s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:43 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Deleted volume successfully. Jul 10 06:44:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f27c29a5-fe46-4769-8056-de8e32d69556 tempest-VolumeQuotasAdminTestJSON-1261704627 None] Lock "cinder-dd276e71-f89d-46d1-9939-8b28259022e1-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a328fb64-784d-47e1-92d5-d742eaf29340 tempest-GroupsV320Test-2097201881 None] Group tempest-GroupsV320Test-Group-1501329919: creating Jul 10 06:44:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a328fb64-784d-47e1-92d5-d742eaf29340 tempest-GroupsV320Test-2097201881 None] Group tempest-GroupsV320Test-Group-1501329919: created successfully Jul 10 06:44:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a328fb64-784d-47e1-92d5-d742eaf29340 tempest-GroupsV320Test-2097201881 None] Create group completed successfully. Jul 10 06:44:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Acquiring lock "cinder-e893d176-508b-4fef-8381-68b4c67e6766-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Lock "cinder-e893d176-508b-4fef-8381-68b4c67e6766-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Acquiring lock "cinder-quobyte-e893d176-508b-4fef-8381-68b4c67e6766" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Lock "cinder-quobyte-e893d176-508b-4fef-8381-68b4c67e6766" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7331bb-832a-4e93-92db-e01ca2ffce37]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:45 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766 Jul 10 06:44:45 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:46 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-285efc00-5f46-4282-a868-f59859a994fe tempest-GroupsV320Test-2097201881 None] Created reservations ['85eff512-c879-4281-9e5a-bc543637136a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-285efc00-5f46-4282-a868-f59859a994fe tempest-GroupsV320Test-2097201881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-285efc00-5f46-4282-a868-f59859a994fe tempest-GroupsV320Test-2097201881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-285efc00-5f46-4282-a868-f59859a994fe tempest-GroupsV320Test-2097201881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-285efc00-5f46-4282-a868-f59859a994fe tempest-GroupsV320Test-2097201881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-285efc00-5f46-4282-a868-f59859a994fe tempest-GroupsV320Test-2097201881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-285efc00-5f46-4282-a868-f59859a994fe tempest-GroupsV320Test-2097201881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:46 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:46 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:46 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766" returned: 0 in 0.912s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:46 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766 Jul 10 06:44:46 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:46 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-285efc00-5f46-4282-a868-f59859a994fe tempest-GroupsV320Test-2097201881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.817s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:46 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-285efc00-5f46-4282-a868-f59859a994fe tempest-GroupsV320Test-2097201881 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-285efc00-5f46-4282-a868-f59859a994fe tempest-GroupsV320Test-2097201881 None] Delete group completed successfully. Jul 10 06:44:47 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e893d176-508b-4fef-8381-68b4c67e6766" returned: 0 in 0.835s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Lock "cinder-quobyte-e893d176-508b-4fef-8381-68b4c67e6766" released by "delete_volume" :: held 1.792s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Created reservations ['6225de38-8f95-4890-a270-18e75579b2c6', 'ab13afb6-78f1-4454-9eef-164377875358', 'b2a1b096-cccf-4381-915a-dc4a9af9cd75', '7bc15f45-014b-44f6-8f68-0cae05eeb95d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:47 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:47 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Acquiring lock "cinder-92977499-1426-4336-ab67-68dfcb173b27-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Lock "cinder-92977499-1426-4336-ab67-68dfcb173b27-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Acquiring lock "cinder-quobyte-92977499-1426-4336-ab67-68dfcb173b27" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Lock "cinder-quobyte-92977499-1426-4336-ab67-68dfcb173b27" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb1ddbd-52dc-4b75-8493-8a1e2d411d61]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:47 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27 Jul 10 06:44:47 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:48 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.921s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:48 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Deleted volume successfully. Jul 10 06:44:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-949f9f61-7863-4fb1-b4de-a9f3c516fc01 tempest-VolumesTestJSON-1632397101 None] Lock "cinder-e893d176-508b-4fef-8381-68b4c67e6766-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:48 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27" returned: 0 in 1.079s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:48 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27 Jul 10 06:44:48 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:49 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-92977499-1426-4336-ab67-68dfcb173b27" returned: 0 in 0.830s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Lock "cinder-quobyte-92977499-1426-4336-ab67-68dfcb173b27" released by "delete_volume" :: held 2.012s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:49 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Created reservations ['5f1a0928-7dce-4ea7-bb95-6bd3df4e9c75', '6578822c-6659-4f54-a620-78a0028b8d19', 'c6cb8476-aa41-4a60-ad78-135ce0496d5d', 'e05676b0-beb0-4840-9d91-3158bc07782d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Acquiring lock "cinder-096fb5cd-7362-4fb2-8a1a-5e71e83d7741-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:49 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:49 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Lock "cinder-096fb5cd-7362-4fb2-8a1a-5e71e83d7741-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Acquiring lock "cinder-quobyte-096fb5cd-7362-4fb2-8a1a-5e71e83d7741" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Lock "cinder-quobyte-096fb5cd-7362-4fb2-8a1a-5e71e83d7741" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[440f03b8-4b38-423d-a497-f7a799b0e20d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:50 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741 Jul 10 06:44:50 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:50 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.825s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:50 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Deleted volume successfully. Jul 10 06:44:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9216d369-cb0f-46c3-968a-bc237a772abf tempest-VolumesTestJSON-1632397101 None] Lock "cinder-92977499-1426-4336-ab67-68dfcb173b27-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:51 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741" returned: 0 in 1.171s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:51 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741 Jul 10 06:44:51 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:52 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-096fb5cd-7362-4fb2-8a1a-5e71e83d7741" returned: 0 in 0.933s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Lock "cinder-quobyte-096fb5cd-7362-4fb2-8a1a-5e71e83d7741" released by "delete_volume" :: held 2.186s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:52 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Created reservations ['9a14c64f-93d8-4a69-be10-68d9a1af3d2a', '2afdb1f6-f740-4e6b-8f16-1b4706879e41', '46f4128d-bbc5-46e7-843d-15b18f3f7cfa', 'f941fef8-56a9-47d6-bc69-f2619e34e597'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:52 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:52 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Flow 'volume_create_manager' (f33ed150-4a70-40d2-aba4-9c579c074a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce919fea-247d-415c-b5f9-7182e94b7e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce919fea-247d-415c-b5f9-7182e94b7e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1517521800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daae2ea-63e7-4a43-b125-f5ce843286e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d15659f3764218a9b6ab384a4081eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:53Z,use_quota=True,user_id='ceb326f7272245bf921fd1be453fb1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9585a3d-21d0-4924-8d32-c3db9d71ed8c),volume_type_id=b9585a3d-21d0-4924-8d32-c3db9d71ed8c)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee44cc7e-3e44-4ad2-a451-c0d2d223c3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee44cc7e-3e44-4ad2-a451-c0d2d223c3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea749584-9990-4df1-8da3-f7de85dcb1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea749584-9990-4df1-8da3-f7de85dcb1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5daae2ea-63e7-4a43-b125-f5ce843286e1', 'volume_name': 'volume-5daae2ea-63e7-4a43-b125-f5ce843286e1', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e059748-278d-4258-84dc-4f73deef59c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e059748-278d-4258-84dc-4f73deef59c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e7e9e5-2551-40ee-851b-6b71380d49bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Volume 5daae2ea-63e7-4a43-b125-f5ce843286e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5daae2ea-63e7-4a43-b125-f5ce843286e1', 'volume_size': 1} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1517521800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daae2ea-63e7-4a43-b125-f5ce843286e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d15659f3764218a9b6ab384a4081eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:53Z,use_quota=True,user_id='ceb326f7272245bf921fd1be453fb1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9585a3d-21d0-4924-8d32-c3db9d71ed8c),volume_type_id=b9585a3d-21d0-4924-8d32-c3db9d71ed8c)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Creating volume 5daae2ea-63e7-4a43-b125-f5ce843286e1 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:53 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:53 devstack sudo[93040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1 1073741824 Jul 10 06:44:53 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:53 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.085s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-bb033c99-4ab6-442d-bc3e-284ba9428735 req-d6918334-da88-4d50-a3d4-d0b2a5f06831 tempest-AttachVolumeShelveTestJSON-541215019 None] No connector for attachment b3972b53-c4ad-46c7-91b4-5dbf7a7344a6; skipping storage backend terminate_connection call. {{(pid=86966) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-bb033c99-4ab6-442d-bc3e-284ba9428735 req-d6918334-da88-4d50-a3d4-d0b2a5f06831 tempest-AttachVolumeShelveTestJSON-541215019 None] Deleting attachment b3972b53-c4ad-46c7-91b4-5dbf7a7344a6. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:44:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Deleted volume successfully. Jul 10 06:44:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5167ad71-5912-4186-8d82-4ff701b2d99c tempest-VolumesTestJSON-1632397101 None] Lock "cinder-096fb5cd-7362-4fb2-8a1a-5e71e83d7741-delete_volume" released by "delete_volume" :: held 3.639s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:54 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1 1073741824" returned: 0 in 1.348s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:54 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1 Jul 10 06:44:54 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:55 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1" returned: 0 in 0.973s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] <== create_volume: return (2391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.394s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e7e9e5-2551-40ee-851b-6b71380d49bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5daae2ea-63e7-4a43-b125-f5ce843286e1', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50150902-dbb9-4444-b1d2-2bd9065e8be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:55 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Volume volume-5daae2ea-63e7-4a43-b125-f5ce843286e1 (5daae2ea-63e7-4a43-b125-f5ce843286e1): created successfully Jul 10 06:44:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50150902-dbb9-4444-b1d2-2bd9065e8be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Flow 'volume_create_manager' (f33ed150-4a70-40d2-aba4-9c579c074a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5dbee9e3-ccbd-43f8-9ff5-71fc827ed5ac tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Created volume successfully. Jul 10 06:44:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0dcedc6e-9bc5-4c63-9fd1-388fc8caf431 tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0dcedc6e-9bc5-4c63-9fd1-388fc8caf431 tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0dcedc6e-9bc5-4c63-9fd1-388fc8caf431 tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0dcedc6e-9bc5-4c63-9fd1-388fc8caf431 tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0dcedc6e-9bc5-4c63-9fd1-388fc8caf431 tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0dcedc6e-9bc5-4c63-9fd1-388fc8caf431 tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:56 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:56 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:57 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0dcedc6e-9bc5-4c63-9fd1-388fc8caf431 tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.737s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:57 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-0dcedc6e-9bc5-4c63-9fd1-388fc8caf431 tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0dcedc6e-9bc5-4c63-9fd1-388fc8caf431 tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Retype volume completed successfully. Jul 10 06:44:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Acquiring lock "cinder-5daae2ea-63e7-4a43-b125-f5ce843286e1-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "cinder-5daae2ea-63e7-4a43-b125-f5ce843286e1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Acquiring lock "cinder-quobyte-5daae2ea-63e7-4a43-b125-f5ce843286e1" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "cinder-quobyte-5daae2ea-63e7-4a43-b125-f5ce843286e1" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c322285-d139-4896-98e0-5f19974b4d1c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:58 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1 Jul 10 06:44:58 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:58 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1" returned: 0 in 0.867s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:58 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1 Jul 10 06:44:58 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:59 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5daae2ea-63e7-4a43-b125-f5ce843286e1" returned: 0 in 0.758s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "cinder-quobyte-5daae2ea-63e7-4a43-b125-f5ce843286e1" released by "delete_volume" :: held 1.694s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:59 devstack cinder-volume[86966]: WARNING cinder.quota [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:44:59 devstack cinder-volume[86966]: WARNING cinder.quota [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:44:59 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Created reservations ['93a59892-f934-4b91-92d6-010b8ac687bb', '1394af46-cb3a-45dd-9a06-016170f24905', 'b32f7926-40c5-4eb9-8401-15fcca465323', '4f40d615-5df5-414d-88be-6450659b513d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:59 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:44:59 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:00 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.880s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:00 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Deleted volume successfully. Jul 10 06:45:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-02698b77-1061-4d99-8567-5d5a20093d4d tempest-VolumeRetypeWithoutMigrationTest-1591846385 None] Lock "cinder-5daae2ea-63e7-4a43-b125-f5ce843286e1-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a5571f73-5fbc-4ad2-a6ee-e10abfe209c3 tempest-GroupSnapshotsTest-76441043 None] Group tempest-GroupSnapshotsTest-Group-152501159: creating Jul 10 06:45:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a5571f73-5fbc-4ad2-a6ee-e10abfe209c3 tempest-GroupSnapshotsTest-76441043 None] Group tempest-GroupSnapshotsTest-Group-152501159: created successfully Jul 10 06:45:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a5571f73-5fbc-4ad2-a6ee-e10abfe209c3 tempest-GroupSnapshotsTest-76441043 None] Create group completed successfully. Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Flow 'volume_create_manager' (049de47e-5b63-4f1c-87b1-635705248367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0ae439-1807-47c1-b701-7cf188ea5fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0ae439-1807-47c1-b701-7cf188ea5fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1028229062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4830f1d8-615b-4320-a3f8-0cdb6d579766,host='devstack@QuobyteHD#QuobyteHD',id=bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d00561cbac4b31932b4e1d487b2c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:07Z,use_quota=True,user_id='2339c8232f0f48f084dee6ea9dfc44c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77a5e003-9f1b-479c-a845-824621ee8196),volume_type_id=77a5e003-9f1b-479c-a845-824621ee8196)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d05ea8-1bd6-40ba-9b5f-c8fff5fe884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d05ea8-1bd6-40ba-9b5f-c8fff5fe884a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3527b748-4806-4436-a6f4-e1346d3cf1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3527b748-4806-4436-a6f4-e1346d3cf1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6', 'volume_name': 'volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b30e96c-4f10-4722-aae7-d4490f8eea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b30e96c-4f10-4722-aae7-d4490f8eea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dcb4c6-f616-41bb-96f4-98bd2ad49ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Volume bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6', 'volume_size': 1} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4830f1d8-615b-4320-a3f8-0cdb6d579766,created_at=2026-07-10T04:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1028229062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4830f1d8-615b-4320-a3f8-0cdb6d579766,host='devstack@QuobyteHD#QuobyteHD',id=bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d00561cbac4b31932b4e1d487b2c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:07Z,use_quota=True,user_id='2339c8232f0f48f084dee6ea9dfc44c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77a5e003-9f1b-479c-a845-824621ee8196),volume_type_id=77a5e003-9f1b-479c-a845-824621ee8196)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Creating volume bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:07 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:45:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:07 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 1073741824 Jul 10 06:45:07 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:08 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 1073741824" returned: 0 in 1.182s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:08 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 Jul 10 06:45:08 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Flow 'volume_create_manager' (ecea9b7d-031e-4d07-aa55-08bd8ecc92e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5fe2d0-7aad-4ee7-b3cb-b88583667176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5fe2d0-7aad-4ee7-b3cb-b88583667176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1859529561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b46c17f-c1ea-4d4a-bab1-10540194cf75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93179c5fda0a4cbeadcf0278c5fd6a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:09Z,use_quota=True,user_id='0a250b9a76764ae4a4501f04672ef4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031b0b5c-182a-4ece-9a75-1d4ece62e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031b0b5c-182a-4ece-9a75-1d4ece62e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79883327-f44f-449a-b46a-58ef44878f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79883327-f44f-449a-b46a-58ef44878f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b46c17f-c1ea-4d4a-bab1-10540194cf75', 'volume_name': 'volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a741f1-38a6-4ca4-b440-069bd907df2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a741f1-38a6-4ca4-b440-069bd907df2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c8b8a9-1cb5-49e1-8020-c29bf287f04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Volume 3b46c17f-c1ea-4d4a-bab1-10540194cf75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75', 'volume_size': 1} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:09 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" returned: 0 in 0.857s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.267s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1859529561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b46c17f-c1ea-4d4a-bab1-10540194cf75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93179c5fda0a4cbeadcf0278c5fd6a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:09Z,use_quota=True,user_id='0a250b9a76764ae4a4501f04672ef4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Creating volume 3b46c17f-c1ea-4d4a-bab1-10540194cf75 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:09 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:09 devstack sudo[93109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 1073741824 Jul 10 06:45:09 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dcb4c6-f616-41bb-96f4-98bd2ad49ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a020ed19-8637-41f8-bf3c-8781dac4d585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:09 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Volume volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 (bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6): created successfully Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a020ed19-8637-41f8-bf3c-8781dac4d585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Flow 'volume_create_manager' (049de47e-5b63-4f1c-87b1-635705248367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-405077c4-749b-4167-94d6-3a362470e654 tempest-GroupSnapshotsTest-76441043 None] Created volume successfully. Jul 10 06:45:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] GroupSnapshot 46c8caa7-975f-4a04-be8b-cbab93707104: creating. Jul 10 06:45:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] Group snapshot 46c8caa7-975f-4a04-be8b-cbab93707104: creating. {{(pid=86966) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 06:45:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:10 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 1073741824" returned: 0 in 1.125s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:10 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 Jul 10 06:45:10 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:11 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75" returned: 0 in 0.672s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.113s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c8b8a9-1cb5-49e1-8020-c29bf287f04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e53bdfe-62d8-42c8-bf5f-3aadd3bbf91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Volume volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 (3b46c17f-c1ea-4d4a-bab1-10540194cf75): created successfully Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e53bdfe-62d8-42c8-bf5f-3aadd3bbf91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Flow 'volume_create_manager' (ecea9b7d-031e-4d07-aa55-08bd8ecc92e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] Creating offline snapshot 1b3ee938-8eed-4646-92be-37a1140e2d4d of volume bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cc93064a-85f0-4a58-8b08-45a89614802e tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Created volume successfully. Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ba0efb-720c-4f4a-831c-347c5b66180f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:11 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:45:11 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:11 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 Jul 10 06:45:11 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:12 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.780s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 9 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:45:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:45:12 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" returned: 0 in 0.947s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:12 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d 1G Jul 10 06:45:12 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:13 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d 1G" returned: 0 in 1.087s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:13 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d Jul 10 06:45:13 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:14 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d" returned: 0 in 0.866s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:14 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:45:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:14 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d Jul 10 06:45:14 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:15 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d" returned: 0 in 0.652s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:15 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.info Jul 10 06:45:15 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:15 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.info" returned: 0 in 0.769s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:15 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:45:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:15 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.info Jul 10 06:45:15 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:16 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.info" returned: 0 in 0.891s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.400s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.165s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Creating offline snapshot 858c794b-8ffa-495a-9fb2-1e730392cf95 of volume 3b46c17f-c1ea-4d4a-bab1-10540194cf75 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:45:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a22eebf-4200-4cb6-862c-76755fd50614]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-94e79c16-86d0-4564-8109-17034b6ba6f6 tempest-GroupSnapshotsTest-76441043 None] group_snapshot 46c8caa7-975f-4a04-be8b-cbab93707104: created successfully Jul 10 06:45:17 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 Jul 10 06:45:17 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:18 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75" returned: 0 in 1.268s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:18 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 1G Jul 10 06:45:18 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:19 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 1G" returned: 0 in 1.059s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:19 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 Jul 10 06:45:19 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:20 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95" returned: 0 in 0.926s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:20 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 is being set with open permissions: ugo+rw Jul 10 06:45:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:20 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 Jul 10 06:45:20 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:21 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95" returned: 0 in 0.762s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:21 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.info Jul 10 06:45:21 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:21 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.info" returned: 0 in 0.730s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:21 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.info is being set with open permissions: ugo+rw Jul 10 06:45:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:21 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.info Jul 10 06:45:21 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:22 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.info" returned: 0 in 0.696s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.633s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.069s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-1b3ee938-8eed-4646-92be-37a1140e2d4d-e397f548-c7c0-41fc-90cf-10276805c402" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-1b3ee938-8eed-4646-92be-37a1140e2d4d-e397f548-c7c0-41fc-90cf-10276805c402" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Creating volume e397f548-c7c0-41fc-90cf-10276805c402 from snapshot 1b3ee938-8eed-4646-92be-37a1140e2d4d {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-e397f548-c7c0-41fc-90cf-10276805c402" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bccab31d-d4b4-4fd8-b4af-642d1d46346a tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Create snapshot completed successfully Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-e397f548-c7c0-41fc-90cf-10276805c402" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] snapshot: 1b3ee938-8eed-4646-92be-37a1140e2d4d, volume: e397f548-c7c0-41fc-90cf-10276805c402, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2babdf-074a-4878-9fb4-ee5600cacb08]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:22 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d Jul 10 06:45:22 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:23 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d" returned: 0 in 1.006s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:45:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:45:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:45:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[25644c66-fa7b-4d32-be63-f42ea6aa8a44]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:23 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 Jul 10 06:45:23 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Acquiring lock "cinder-858c794b-8ffa-495a-9fb2-1e730392cf95-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "cinder-858c794b-8ffa-495a-9fb2-1e730392cf95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Acquiring lock "cinder-quobyte-3b46c17f-c1ea-4d4a-bab1-10540194cf75" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "cinder-quobyte-3b46c17f-c1ea-4d4a-bab1-10540194cf75" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Acquiring lock "cinder-quobyte-858c794b-8ffa-495a-9fb2-1e730392cf95" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "cinder-quobyte-858c794b-8ffa-495a-9fb2-1e730392cf95" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Deleting offline snapshot 858c794b-8ffa-495a-9fb2-1e730392cf95 of volume 3b46c17f-c1ea-4d4a-bab1-10540194cf75 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] snapshot_file for this snap is: volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee53c77-490d-4f7f-9528-9a1fd041bf8d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:24 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 Jul 10 06:45:24 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:24 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" returned: 0 in 1.248s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:45:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:24 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402 Jul 10 06:45:24 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:25 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95" returned: 0 in 1.056s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:45:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d04cf9-a19b-48a3-a3ba-2b01617dab7b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:25 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 Jul 10 06:45:25 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:27 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75" returned: 0 in 1.964s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:27 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 Jul 10 06:45:27 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:29 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95" returned: 0 in 2.343s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:29 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95 Jul 10 06:45:29 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:31 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75.858c794b-8ffa-495a-9fb2-1e730392cf95" returned: 0 in 1.852s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:31 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=121,cinder:SELECT=81,cinder:DELETE=11,cinder:INSERT=28 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:45:31 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=108,cinder:UPDATE=101,cinder:INSERT=18,cinder:DELETE=5 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:45:31 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402" returned: 0 in 6.728s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "cinder-quobyte-858c794b-8ffa-495a-9fb2-1e730392cf95" released by "_delete_snapshot" :: held 7.372s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "cinder-quobyte-3b46c17f-c1ea-4d4a-bab1-10540194cf75" released by "delete_snapshot" :: held 7.424s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca34c0ab-e2a0-4cd1-a5b8-e54125b4c128]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:31 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Created reservations ['9c6daa64-0614-4559-864a-ae6a7af3affc', '64e4a2b5-72ba-4dd7-9f73-8b316474e01f', '332b3d31-861d-4ea0-a740-93864cf80c80', 'b5c28765-3d6d-489a-a9b3-b6f5d23f4720'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:31 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 Jul 10 06:45:31 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Delete snapshot completed successfully. Jul 10 06:45:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4d6ebe0b-9272-41a8-b27b-ea609bd4e8d2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "cinder-858c794b-8ffa-495a-9fb2-1e730392cf95-delete_snapshot" released by "delete_snapshot" :: held 7.631s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Acquiring lock "cinder-3b46c17f-c1ea-4d4a-bab1-10540194cf75-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "cinder-3b46c17f-c1ea-4d4a-bab1-10540194cf75-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Acquiring lock "cinder-quobyte-3b46c17f-c1ea-4d4a-bab1-10540194cf75" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "cinder-quobyte-3b46c17f-c1ea-4d4a-bab1-10540194cf75" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e38222-8e59-4fad-829f-2a387db6d981]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:32 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 Jul 10 06:45:32 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:32 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" returned: 0 in 1.097s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:32 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6, size 1024.00 MB, duration 6.73 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:45:32 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Converted 1024.00 MB image at 152.17 MB/s Jul 10 06:45:32 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:45:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:32 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402 Jul 10 06:45:32 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:33 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75" returned: 0 in 0.998s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:33 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75 Jul 10 06:45:33 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:33 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402" returned: 0 in 0.971s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-e397f548-c7c0-41fc-90cf-10276805c402" released by "_copy_volume_from_snapshot" :: held 11.187s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-1b3ee938-8eed-4646-92be-37a1140e2d4d-e397f548-c7c0-41fc-90cf-10276805c402" released by "_create_volume_from_snapshot" :: held 11.240s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.279s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b8c89353-c60a-4b07-ae11-0559b29e4b75 tempest-GroupSnapshotsTest-76441043 None] Create group from source-snapshot-46c8caa7-975f-4a04-be8b-cbab93707104 completed successfully. Jul 10 06:45:34 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b46c17f-c1ea-4d4a-bab1-10540194cf75" returned: 0 in 0.816s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "cinder-quobyte-3b46c17f-c1ea-4d4a-bab1-10540194cf75" released by "delete_volume" :: held 1.909s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:34 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Created reservations ['15b043eb-3aa5-44d8-94a5-a8baa2aee7b7', '06e0ba2b-9bdd-4c8f-b33c-de1364bcb469', 'ca4e5315-32b6-4bfb-8f12-71509eb0eefd', '31dbbd50-f583-46ef-a2c4-26f7220cdb5b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:34 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:45:34 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-e397f548-c7c0-41fc-90cf-10276805c402" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-e397f548-c7c0-41fc-90cf-10276805c402" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9bd805-afa5-407a-90fe-7b48985de29a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:35 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.213s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:35 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Deleted volume successfully. Jul 10 06:45:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a24385d2-17ac-4427-9364-003c83c58465 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907233600 None] Lock "cinder-3b46c17f-c1ea-4d4a-bab1-10540194cf75-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:35 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402 Jul 10 06:45:35 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:36 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402" returned: 0 in 1.489s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:36 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402 Jul 10 06:45:36 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:37 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e397f548-c7c0-41fc-90cf-10276805c402" returned: 0 in 0.804s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-e397f548-c7c0-41fc-90cf-10276805c402" released by "delete_volume" :: held 2.347s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:37 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Created reservations ['790cda3d-ad47-4b27-960f-e1288c4b3540'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:37 devstack cinder-volume[86966]: WARNING cinder.quota [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-365865010 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-365865010, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:45:37 devstack cinder-volume[86966]: WARNING cinder.quota [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-365865010 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-365865010, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:45:37 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Created reservations ['4044ef2a-f6e9-47fa-98e6-11b3cff1d263', '2a05b678-c513-4f88-abca-8c5fae077ad8', '31723576-9a35-43e9-bc60-158e9124c5f8', '79d53003-8229-4669-8590-88e6d794ba31'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:38 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:45:38 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] group_snapshot 46c8caa7-975f-4a04-be8b-cbab93707104: deleting Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] group_snapshot 46c8caa7-975f-4a04-be8b-cbab93707104: deleting {{(pid=86966) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" acquired by "delete_snapshot" :: waited 0.068s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-1b3ee938-8eed-4646-92be-37a1140e2d4d" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-1b3ee938-8eed-4646-92be-37a1140e2d4d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Deleting offline snapshot 1b3ee938-8eed-4646-92be-37a1140e2d4d of volume bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] snapshot_file for this snap is: volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0382ee63-b9d0-455f-945f-d226340cfe17]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:38 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d Jul 10 06:45:38 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:39 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.081s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:39 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8b9d4f93-ece7-49a5-a0e3-42020152211e tempest-GroupSnapshotsTest-76441043 None] Delete group completed successfully. Jul 10 06:45:39 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d" returned: 0 in 1.097s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:45:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[20996515-e9cb-4518-83dd-dc8be8f99b9e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:40 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 Jul 10 06:45:40 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:41 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" returned: 0 in 1.558s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:41 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d Jul 10 06:45:41 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:42 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d" returned: 0 in 0.970s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:42 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d Jul 10 06:45:42 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:43 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6.1b3ee938-8eed-4646-92be-37a1140e2d4d" returned: 0 in 0.811s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-1b3ee938-8eed-4646-92be-37a1140e2d4d" released by "_delete_snapshot" :: held 4.614s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" released by "delete_snapshot" :: held 4.659s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:43 devstack cinder-volume[86966]: WARNING cinder.quota [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-365865010 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-365865010, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] Created reservations ['2f5ab265-98b8-49bf-ace8-63539c235814', 'bb2ccfac-9774-49b9-a8b2-d41f99351ad8', '8c88e270-76c8-4f0d-ac76-818dc63ccde5', 'adc107b7-4164-407c-a5b6-6f72d331b120'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-30563d78-bf5c-4cb0-bb78-717c5fcb557c tempest-GroupSnapshotsTest-76441043 None] group_snapshot 46c8caa7-975f-4a04-be8b-cbab93707104: deleted successfully Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Flow 'volume_create_manager' (30f6f3ca-5b20-472d-aa5a-9840892f8ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9841dbd-d3ec-42c6-8a6d-2546a2dbc940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9841dbd-d3ec-42c6-8a6d-2546a2dbc940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-28362167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80030606-8aed-469d-af8b-29d4e2ea382e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebb979e56314d8b9712e9a348c60bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:43Z,use_quota=True,user_id='e2534f3b87d841f3bf6e06cc0e40eecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751dd6a7-137d-46e4-bfa5-797e380d6474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (751dd6a7-137d-46e4-bfa5-797e380d6474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4288c1b-70e7-4e94-82fe-9404c8606b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4288c1b-70e7-4e94-82fe-9404c8606b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80030606-8aed-469d-af8b-29d4e2ea382e', 'volume_name': 'volume-80030606-8aed-469d-af8b-29d4e2ea382e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ddfda6-a64b-412f-99b8-ea4914f0157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ddfda6-a64b-412f-99b8-ea4914f0157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d78740-db38-4536-97ae-2f91b08896c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Volume 80030606-8aed-469d-af8b-29d4e2ea382e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80030606-8aed-469d-af8b-29d4e2ea382e', 'volume_size': 1} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-28362167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80030606-8aed-469d-af8b-29d4e2ea382e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebb979e56314d8b9712e9a348c60bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:43Z,use_quota=True,user_id='e2534f3b87d841f3bf6e06cc0e40eecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Creating volume 80030606-8aed-469d-af8b-29d4e2ea382e {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:43 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:45:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:43 devstack sudo[93411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e 1073741824 Jul 10 06:45:43 devstack sudo[93411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71161a1-c991-4af9-97ef-afcd61cbc2c9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:44 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 Jul 10 06:45:44 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:44 devstack sudo[93411]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e 1073741824" returned: 0 in 1.062s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:44 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e Jul 10 06:45:44 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:45 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e" returned: 0 in 0.740s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d78740-db38-4536-97ae-2f91b08896c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80030606-8aed-469d-af8b-29d4e2ea382e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:45 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd797192-d424-4ad1-9bc6-afa2b6bfab75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" returned: 0 in 1.044s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Volume volume-80030606-8aed-469d-af8b-29d4e2ea382e (80030606-8aed-469d-af8b-29d4e2ea382e): created successfully Jul 10 06:45:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd797192-d424-4ad1-9bc6-afa2b6bfab75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:45 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6 Jul 10 06:45:45 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Flow 'volume_create_manager' (30f6f3ca-5b20-472d-aa5a-9840892f8ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d0a9c78d-e8ba-4b85-9e03-b9e76ae97306 tempest-VolumesListAdminTestJSON-535768798 None] Created volume successfully. Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Acquiring lock "cinder-329b3d7f-c326-439f-a93a-a4f700a2b019-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Lock "cinder-329b3d7f-c326-439f-a93a-a4f700a2b019-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Acquiring lock "cinder-quobyte-329b3d7f-c326-439f-a93a-a4f700a2b019" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Lock "cinder-quobyte-329b3d7f-c326-439f-a93a-a4f700a2b019" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[885d0f5f-5963-406a-837c-3a8aa723b560]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:46 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" returned: 0 in 0.852s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-bc5828c1-d920-4d2b-9d84-9a2cf6bacfc6" released by "delete_volume" :: held 1.971s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:46 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019 Jul 10 06:45:46 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Created reservations ['d80fea65-cd94-4d90-a821-52f165058e12'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:46 devstack cinder-volume[86966]: WARNING cinder.db.api [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-365865010'] Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Created reservations ['c2965e76-269c-4ed3-a001-5bb7629ba0d3', 'c79700a6-3acd-44d8-a7ad-5118ed710bec', '94aa8d55-6523-4efc-b15c-8fb3c6c49ffd', '4076cbac-b635-421e-90cf-2810a5266906'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:46 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:45:46 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:47 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019" returned: 0 in 1.151s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:47 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.818s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-34dfc886-476d-43f3-97b0-37ad7b45d7b1 tempest-GroupSnapshotsTest-76441043 None] Delete group completed successfully. Jul 10 06:45:47 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019 Jul 10 06:45:47 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Flow 'volume_create_manager' (85293705-a2a3-4a27-805f-ef7bbd973282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5218c88-3355-4d7d-ae85-8ede96e669a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5218c88-3355-4d7d-ae85-8ede96e669a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-537715587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caeb03a4-ed98-4554-8b6a-0b597641965f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebb979e56314d8b9712e9a348c60bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:47Z,use_quota=True,user_id='e2534f3b87d841f3bf6e06cc0e40eecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536f98f4-1f42-41c7-8923-3627c4b45cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536f98f4-1f42-41c7-8923-3627c4b45cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed936dc-35d7-49b5-8a18-fb3b77d3df2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ed936dc-35d7-49b5-8a18-fb3b77d3df2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caeb03a4-ed98-4554-8b6a-0b597641965f', 'volume_name': 'volume-caeb03a4-ed98-4554-8b6a-0b597641965f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b30d860-f630-4135-b2d0-7816c503362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b30d860-f630-4135-b2d0-7816c503362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad25290-a047-49da-a6af-f5a17a887b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Volume caeb03a4-ed98-4554-8b6a-0b597641965f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caeb03a4-ed98-4554-8b6a-0b597641965f', 'volume_size': 1} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-537715587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caeb03a4-ed98-4554-8b6a-0b597641965f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebb979e56314d8b9712e9a348c60bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:47Z,use_quota=True,user_id='e2534f3b87d841f3bf6e06cc0e40eecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Creating volume caeb03a4-ed98-4554-8b6a-0b597641965f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:47 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:45:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e4f04005-7b90-40a0-abaf-7e7ed81af0b4 tempest-GroupSnapshotsTest-76441043 None] Group tempest-GroupSnapshotsTest-Group-63951713: creating Jul 10 06:45:47 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f 1073741824 Jul 10 06:45:47 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e4f04005-7b90-40a0-abaf-7e7ed81af0b4 tempest-GroupSnapshotsTest-76441043 None] Group tempest-GroupSnapshotsTest-Group-63951713: created successfully Jul 10 06:45:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e4f04005-7b90-40a0-abaf-7e7ed81af0b4 tempest-GroupSnapshotsTest-76441043 None] Create group completed successfully. Jul 10 06:45:48 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-329b3d7f-c326-439f-a93a-a4f700a2b019" returned: 0 in 0.856s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Lock "cinder-quobyte-329b3d7f-c326-439f-a93a-a4f700a2b019" released by "delete_volume" :: held 2.070s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:48 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Created reservations ['1bd2e33d-48da-40c7-944a-8d020b3ad419', '6cd0ceee-d8cd-4286-924c-30be3e2a8d61', '509c9ef0-20cb-48d3-8a8f-e5b3a90cff52', '51f33f2a-062b-4fd9-a41c-8f70ce12af48'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:48 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:45:48 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:48 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f 1073741824" returned: 0 in 1.213s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:48 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f Jul 10 06:45:48 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:49 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.932s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Deleted volume successfully. Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-64a6da96-7d87-41cd-a150-9160ecfdca30 tempest-AttachVolumeShelveTestJSON-541215019 None] Lock "cinder-329b3d7f-c326-439f-a93a-a4f700a2b019-delete_volume" released by "delete_volume" :: held 3.388s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Flow 'volume_create_manager' (3d2d062c-ff95-46bf-b23a-c8744ce8b04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fe439b-a7a7-4bb6-8a76-1e0a51551857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fe439b-a7a7-4bb6-8a76-1e0a51551857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-84281818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acaf6694-e928-4ad4-8868-2bde2876601c,host='devstack@QuobyteHD#QuobyteHD',id=b708a896-43e8-4379-ba61-4fe2b2690e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d00561cbac4b31932b4e1d487b2c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:50Z,use_quota=True,user_id='2339c8232f0f48f084dee6ea9dfc44c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36440fca-39ce-4574-80aa-a3398c2b9c2e),volume_type_id=36440fca-39ce-4574-80aa-a3398c2b9c2e)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903b7f99-0e2c-46af-b73d-00ffac8bc8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903b7f99-0e2c-46af-b73d-00ffac8bc8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a43043a-5ea4-487f-9423-0a9f7039c6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a43043a-5ea4-487f-9423-0a9f7039c6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b708a896-43e8-4379-ba61-4fe2b2690e9c', 'volume_name': 'volume-b708a896-43e8-4379-ba61-4fe2b2690e9c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11b901f-d7e7-4d9f-ab39-c94ca5349dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11b901f-d7e7-4d9f-ab39-c94ca5349dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8cb84e-ae5c-459a-b1d7-62e0d977e024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:49 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Volume b708a896-43e8-4379-ba61-4fe2b2690e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b708a896-43e8-4379-ba61-4fe2b2690e9c', 'volume_size': 1} Jul 10 06:45:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:50 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f" returned: 0 in 1.152s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] <== create_volume: return (2434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.436s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.131s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=acaf6694-e928-4ad4-8868-2bde2876601c,created_at=2026-07-10T04:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-84281818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acaf6694-e928-4ad4-8868-2bde2876601c,host='devstack@QuobyteHD#QuobyteHD',id=b708a896-43e8-4379-ba61-4fe2b2690e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d00561cbac4b31932b4e1d487b2c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:50Z,use_quota=True,user_id='2339c8232f0f48f084dee6ea9dfc44c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36440fca-39ce-4574-80aa-a3398c2b9c2e),volume_type_id=36440fca-39ce-4574-80aa-a3398c2b9c2e)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Creating volume b708a896-43e8-4379-ba61-4fe2b2690e9c {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:50 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad25290-a047-49da-a6af-f5a17a887b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caeb03a4-ed98-4554-8b6a-0b597641965f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:50 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c 1073741824 Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976b0741-58aa-4b57-b29c-540f6dd702eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:50 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:50 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Volume volume-caeb03a4-ed98-4554-8b6a-0b597641965f (caeb03a4-ed98-4554-8b6a-0b597641965f): created successfully Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976b0741-58aa-4b57-b29c-540f6dd702eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Flow 'volume_create_manager' (85293705-a2a3-4a27-805f-ef7bbd973282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7f0a17ce-f1f5-4a46-b759-a188940204cc tempest-VolumesListAdminTestJSON-535768798 None] Created volume successfully. Jul 10 06:45:51 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c 1073741824" returned: 0 in 1.284s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:51 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c Jul 10 06:45:51 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Flow 'volume_create_manager' (5dd5f5f1-9c5a-40a4-a1e3-15fdcbdf9764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcaa4bf-23e9-4808-af6a-4b06410ce825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcaa4bf-23e9-4808-af6a-4b06410ce825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1025839213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541c8470-b384-4419-84ff-e21a52916600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebb979e56314d8b9712e9a348c60bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:51Z,use_quota=True,user_id='e2534f3b87d841f3bf6e06cc0e40eecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd2ec30-f4e0-42f3-b316-af148be547b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd2ec30-f4e0-42f3-b316-af148be547b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033a3759-c210-4097-b330-13c9a1e0d3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033a3759-c210-4097-b330-13c9a1e0d3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541c8470-b384-4419-84ff-e21a52916600', 'volume_name': 'volume-541c8470-b384-4419-84ff-e21a52916600', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79bbfdd-0ec0-4ddd-987e-edf4e61f9362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79bbfdd-0ec0-4ddd-987e-edf4e61f9362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff58b114-bcae-4ed9-8e76-5faa105e1324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:51 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Volume 541c8470-b384-4419-84ff-e21a52916600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541c8470-b384-4419-84ff-e21a52916600', 'volume_size': 1} Jul 10 06:45:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:52 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c" returned: 0 in 0.834s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1025839213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541c8470-b384-4419-84ff-e21a52916600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebb979e56314d8b9712e9a348c60bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:51Z,use_quota=True,user_id='e2534f3b87d841f3bf6e06cc0e40eecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Creating volume 541c8470-b384-4419-84ff-e21a52916600 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:52 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8cb84e-ae5c-459a-b1d7-62e0d977e024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b708a896-43e8-4379-ba61-4fe2b2690e9c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1b1776-f3c0-4cee-8603-0cc88e55445d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:52 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600 1073741824 Jul 10 06:45:52 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:52 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Volume volume-b708a896-43e8-4379-ba61-4fe2b2690e9c (b708a896-43e8-4379-ba61-4fe2b2690e9c): created successfully Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1b1776-f3c0-4cee-8603-0cc88e55445d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Flow 'volume_create_manager' (3d2d062c-ff95-46bf-b23a-c8744ce8b04a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-50569ead-dcd4-462b-8631-63deb84d5183 tempest-GroupSnapshotsTest-76441043 None] Created volume successfully. Jul 10 06:45:53 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600 1073741824" returned: 0 in 1.146s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:53 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600 Jul 10 06:45:53 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:54 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600" returned: 0 in 1.083s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] <== create_volume: return (2291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff58b114-bcae-4ed9-8e76-5faa105e1324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541c8470-b384-4419-84ff-e21a52916600', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa56390-982d-47c3-9be5-1a62abe821ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Flow 'volume_create_manager' (fa354a6d-6732-46a2-b645-ce2a7d1ae690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de29a5f-8649-446f-a6ab-a4ebd268d88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:54 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Volume volume-541c8470-b384-4419-84ff-e21a52916600 (541c8470-b384-4419-84ff-e21a52916600): created successfully Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa56390-982d-47c3-9be5-1a62abe821ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Flow 'volume_create_manager' (5dd5f5f1-9c5a-40a4-a1e3-15fdcbdf9764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5de29a5f-8649-446f-a6ab-a4ebd268d88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1384745381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acaf6694-e928-4ad4-8868-2bde2876601c,host='devstack@QuobyteHD#QuobyteHD',id=b781c9ed-3ae1-421f-843e-5fd1002c9725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d00561cbac4b31932b4e1d487b2c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:54Z,use_quota=True,user_id='2339c8232f0f48f084dee6ea9dfc44c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36440fca-39ce-4574-80aa-a3398c2b9c2e),volume_type_id=36440fca-39ce-4574-80aa-a3398c2b9c2e)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c7f3e4-3c9e-4140-8d21-3a490dfd38a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c7f3e4-3c9e-4140-8d21-3a490dfd38a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243ce07e-8792-4b2e-8de3-d9ef28de112f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (243ce07e-8792-4b2e-8de3-d9ef28de112f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b781c9ed-3ae1-421f-843e-5fd1002c9725', 'volume_name': 'volume-b781c9ed-3ae1-421f-843e-5fd1002c9725', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8985009f-b8dc-4a7f-af08-ca9125894a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8985009f-b8dc-4a7f-af08-ca9125894a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf3ac93-8dcc-4467-8b3e-17b6988d7059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:54 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Volume b781c9ed-3ae1-421f-843e-5fd1002c9725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b781c9ed-3ae1-421f-843e-5fd1002c9725', 'volume_size': 1} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=acaf6694-e928-4ad4-8868-2bde2876601c,created_at=2026-07-10T04:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1384745381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acaf6694-e928-4ad4-8868-2bde2876601c,host='devstack@QuobyteHD#QuobyteHD',id=b781c9ed-3ae1-421f-843e-5fd1002c9725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d00561cbac4b31932b4e1d487b2c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:54Z,use_quota=True,user_id='2339c8232f0f48f084dee6ea9dfc44c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36440fca-39ce-4574-80aa-a3398c2b9c2e),volume_type_id=36440fca-39ce-4574-80aa-a3398c2b9c2e)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Creating volume b781c9ed-3ae1-421f-843e-5fd1002c9725 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:54 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:45:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5fe5d0c5-78b6-4f1e-ab7f-5211d4eaeb87 tempest-VolumesListAdminTestJSON-535768798 None] Created volume successfully. Jul 10 06:45:54 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 1073741824 Jul 10 06:45:54 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:55 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 1073741824" returned: 0 in 1.278s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:56 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 Jul 10 06:45:56 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Flow 'volume_create_manager' (2538cde1-fc59-4a67-a17e-0ad798409fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebfae60-a8fe-442a-afef-12555b573e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ebfae60-a8fe-442a-afef-12555b573e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c84b98-b573-476b-a287-c1d89bc8aaf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf8103f0f564097b028303c29837c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:57Z,use_quota=True,user_id='ac72e3ffe7b942b6acab88f66a924b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769b7f60-09ae-4781-b586-b049738b6151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769b7f60-09ae-4781-b586-b049738b6151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9bb0df-ab87-4bc4-bda8-a8283d837e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9bb0df-ab87-4bc4-bda8-a8283d837e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23c84b98-b573-476b-a287-c1d89bc8aaf8', 'volume_name': 'volume-23c84b98-b573-476b-a287-c1d89bc8aaf8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f073be91-8b48-466e-a89e-39da47d36c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f073be91-8b48-466e-a89e-39da47d36c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12900b52-bc71-4cc7-a18a-7c0efea7ebec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:56 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Volume 23c84b98-b573-476b-a287-c1d89bc8aaf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23c84b98-b573-476b-a287-c1d89bc8aaf8', 'volume_size': 1} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:56 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725" returned: 0 in 0.960s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.166s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c84b98-b573-476b-a287-c1d89bc8aaf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf8103f0f564097b028303c29837c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:57Z,use_quota=True,user_id='ac72e3ffe7b942b6acab88f66a924b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Creating volume 23c84b98-b573-476b-a287-c1d89bc8aaf8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:57 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf3ac93-8dcc-4467-8b3e-17b6988d7059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b781c9ed-3ae1-421f-843e-5fd1002c9725', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e621b5-2db9-4b65-bf91-5e2c05ce7097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:57 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8 1073741824 Jul 10 06:45:57 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Volume volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 (b781c9ed-3ae1-421f-843e-5fd1002c9725): created successfully Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e621b5-2db9-4b65-bf91-5e2c05ce7097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Flow 'volume_create_manager' (fa354a6d-6732-46a2-b645-ce2a7d1ae690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-62bcff31-8d1d-4142-89d8-1315f593b3af tempest-GroupSnapshotsTest-76441043 None] Created volume successfully. Jul 10 06:45:58 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8 1073741824" returned: 0 in 1.004s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:58 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8 Jul 10 06:45:58 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-52fb7d3e-df3b-420e-9f89-c1e1532dff40 tempest-GroupSnapshotsTest-76441043 None] Update group completed successfully. Jul 10 06:45:58 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8" returned: 0 in 0.695s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12900b52-bc71-4cc7-a18a-7c0efea7ebec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c84b98-b573-476b-a287-c1d89bc8aaf8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8508f24b-692f-49d5-b9c4-a69249f4a7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:58 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Volume volume-23c84b98-b573-476b-a287-c1d89bc8aaf8 (23c84b98-b573-476b-a287-c1d89bc8aaf8): created successfully Jul 10 06:45:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8508f24b-692f-49d5-b9c4-a69249f4a7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Flow 'volume_create_manager' (2538cde1-fc59-4a67-a17e-0ad798409fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ca6e36b6-b532-443e-a72d-59b7e28dcf95 tempest-VolumesListAdminTestJSON-1536343770 None] Created volume successfully. Jul 10 06:45:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-89a039f3-785e-4c61-a219-6346b2466532 tempest-GroupSnapshotsTest-76441043 None] Update group completed successfully. Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Acquiring lock "cinder-23c84b98-b573-476b-a287-c1d89bc8aaf8-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Lock "cinder-23c84b98-b573-476b-a287-c1d89bc8aaf8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Acquiring lock "cinder-quobyte-23c84b98-b573-476b-a287-c1d89bc8aaf8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Lock "cinder-quobyte-23c84b98-b573-476b-a287-c1d89bc8aaf8" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d255812e-64a2-4294-867b-7d84d95006a0]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "cinder-541c8470-b384-4419-84ff-e21a52916600-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-541c8470-b384-4419-84ff-e21a52916600-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "cinder-quobyte-541c8470-b384-4419-84ff-e21a52916600" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-quobyte-541c8470-b384-4419-84ff-e21a52916600" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:00 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8 Jul 10 06:46:00 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b34a7f5-b30c-48ee-afd8-1ab4fe7780cf]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:00 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600 Jul 10 06:46:00 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d091f688-42e5-4c2a-8ac3-917a3efc0908 tempest-GroupSnapshotsTest-76441043 None] Update group completed successfully. Jul 10 06:46:01 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8" returned: 0 in 1.019s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:01 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8 Jul 10 06:46:01 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:01 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600" returned: 0 in 1.060s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:01 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600 Jul 10 06:46:01 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2b477c07-a33d-4882-9df5-7bd56af7ec50 tempest-GroupSnapshotsTest-76441043 None] Update group completed successfully. Jul 10 06:46:02 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-541c8470-b384-4419-84ff-e21a52916600" returned: 0 in 0.968s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-quobyte-541c8470-b384-4419-84ff-e21a52916600" released by "delete_volume" :: held 2.075s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:02 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-23c84b98-b573-476b-a287-c1d89bc8aaf8" returned: 0 in 1.189s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Lock "cinder-quobyte-23c84b98-b573-476b-a287-c1d89bc8aaf8" released by "delete_volume" :: held 2.267s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Created reservations ['151d78b2-0f3c-4c83-b61c-4a27ed881bbd', '8c3e5beb-f61f-4842-9a92-08690effa3c1', 'e0af3181-bf73-408a-ae86-d0398c85ac71', '22a0ab2e-9d3b-4ce4-9abb-0fb0e0ff6f39'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Created reservations ['03022d4a-bb1e-4806-a01f-54fe18a52389', '3f5059ea-95fd-4c22-9a0c-2bdee13df54f', '7c04be3e-3aaa-4b75-8278-8bb82a8c1067', 'c9334b59-0d4d-4c61-a4d9-a6c202346342'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:02 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:02 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:02 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:02 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:03 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.819s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Deleted volume successfully. Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-189bb9e3-7cae-46a0-b4c0-ba4a46d9342e tempest-VolumesListAdminTestJSON-1536343770 None] Lock "cinder-23c84b98-b573-476b-a287-c1d89bc8aaf8-delete_volume" released by "delete_volume" :: held 3.499s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "cinder-caeb03a4-ed98-4554-8b6a-0b597641965f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-caeb03a4-ed98-4554-8b6a-0b597641965f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "cinder-quobyte-caeb03a4-ed98-4554-8b6a-0b597641965f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-quobyte-caeb03a4-ed98-4554-8b6a-0b597641965f" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:03 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.328s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Deleted volume successfully. Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb03fa7-8698-4561-a615-f580945c93d5]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ffd9da6-54a1-4a9b-a370-8d029eed8dfc tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-541c8470-b384-4419-84ff-e21a52916600-delete_volume" released by "delete_volume" :: held 3.776s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] GroupSnapshot 96f1acdc-db3c-4ed4-89b9-6ea6fb3d8d3e: creating. Jul 10 06:46:04 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f Jul 10 06:46:04 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Group snapshot 96f1acdc-db3c-4ed4-89b9-6ea6fb3d8d3e: creating. {{(pid=86966) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 06:46:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Creating offline snapshot 5d591211-7b6d-4a41-a146-40f9da3bbe7c of volume b708a896-43e8-4379-ba61-4fe2b2690e9c {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:46:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0232b2-4977-4c14-a644-7961c8e2c06e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:04 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c Jul 10 06:46:04 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:04 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f" returned: 0 in 0.899s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:04 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f Jul 10 06:46:04 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:05 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c" returned: 0 in 1.059s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:05 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c 1G Jul 10 06:46:05 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:05 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-caeb03a4-ed98-4554-8b6a-0b597641965f" returned: 0 in 0.855s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-quobyte-caeb03a4-ed98-4554-8b6a-0b597641965f" released by "delete_volume" :: held 1.830s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:05 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Created reservations ['a4280123-46ce-4bc7-915f-c381f3f7828d', '51a35f18-8046-44a8-9ad6-be121d878f0d', 'de1144ac-204f-404e-86c9-63a5b22d3379', '395f1593-517f-432c-b29d-a3d3568f7201'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:06 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:06 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "cinder-80030606-8aed-469d-af8b-29d4e2ea382e-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-80030606-8aed-469d-af8b-29d4e2ea382e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "cinder-quobyte-80030606-8aed-469d-af8b-29d4e2ea382e" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-quobyte-80030606-8aed-469d-af8b-29d4e2ea382e" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eed4f9-2faf-4381-8950-bc85aa8cda56]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:06 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c 1G" returned: 0 in 1.374s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b708a896-43e8-4379-ba61-4fe2b2690e9c -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:06 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b708a896-43e8-4379-ba61-4fe2b2690e9c -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c Jul 10 06:46:06 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:06 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e Jul 10 06:46:06 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:07 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.059s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:07 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Deleted volume successfully. Jul 10 06:46:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0467813b-258d-4f96-bce4-15255f3e1c60 tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-caeb03a4-ed98-4554-8b6a-0b597641965f-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:07 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b708a896-43e8-4379-ba61-4fe2b2690e9c -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c" returned: 0 in 0.941s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:07 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:46:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:07 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e" returned: 0 in 1.048s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:07 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c Jul 10 06:46:07 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:07 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e Jul 10 06:46:07 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:08 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-80030606-8aed-469d-af8b-29d4e2ea382e" returned: 0 in 0.956s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:08 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c" returned: 0 in 1.001s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-quobyte-80030606-8aed-469d-af8b-29d4e2ea382e" released by "delete_volume" :: held 2.084s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:08 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.info Jul 10 06:46:08 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:08 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Created reservations ['5b47b67e-5bf8-46e7-80b3-594328601a7b', 'b9d67058-53dc-4977-8985-736222c59519', '60ed1190-c9a4-4372-bf58-1a6a4e9a7620', 'dcbf64dd-39d0-40c8-943f-bf0237c78717'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:08 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:08 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:09 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.info" returned: 0 in 1.178s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:09 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:46:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:09 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.info Jul 10 06:46:09 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:10 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.266s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:10 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Deleted volume successfully. Jul 10 06:46:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a018a097-fb6c-4a4f-b75c-a55d04729a2f tempest-VolumesListAdminTestJSON-535768798 None] Lock "cinder-80030606-8aed-469d-af8b-29d4e2ea382e-delete_volume" released by "delete_volume" :: held 3.888s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:10 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.info" returned: 0 in 1.119s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.793s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Creating offline snapshot cc208dbf-8b2d-4f47-979d-7f7b729ebce4 of volume b781c9ed-3ae1-421f-843e-5fd1002c9725 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:46:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2439653-a1b5-4c30-84be-468a37ab6002]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:11 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 Jul 10 06:46:11 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:46:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:11 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:11 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:12 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725" returned: 0 in 1.589s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:12 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 1G Jul 10 06:46:12 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:13 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.612s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:13 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:13 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:46:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 9 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:46:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:46:14 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 1G" returned: 0 in 1.461s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:14 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 Jul 10 06:46:14 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:15 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4" returned: 0 in 1.387s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:15 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:15 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 Jul 10 06:46:15 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (c55208a9-4e97-4ec4-8314-f86164644a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf52d28f-a156-4ac5-9ae4-38f68ad0d30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf52d28f-a156-4ac5-9ae4-38f68ad0d30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-432630388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6423e82-e685-4c8c-8586-5f4f6900e02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:15Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421b34e7-3a35-4c85-a450-663958b40879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421b34e7-3a35-4c85-a450-663958b40879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25649d1a-18a1-43ca-a815-36ec9fb20844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25649d1a-18a1-43ca-a815-36ec9fb20844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6423e82-e685-4c8c-8586-5f4f6900e02d', 'volume_name': 'volume-a6423e82-e685-4c8c-8586-5f4f6900e02d', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38d863e-587f-439a-aeac-933e4f3bbeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38d863e-587f-439a-aeac-933e4f3bbeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b6f903-925b-4c17-a80a-1d6a1cc4ead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Volume a6423e82-e685-4c8c-8586-5f4f6900e02d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6423e82-e685-4c8c-8586-5f4f6900e02d', 'volume_size': 1} Jul 10 06:46:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:16 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4" returned: 0 in 0.843s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:16 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.info Jul 10 06:46:16 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:17 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.info" returned: 0 in 0.927s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:17 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:46:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:17 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.info Jul 10 06:46:17 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:18 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.info" returned: 0 in 1.213s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.572s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.874s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-432630388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6423e82-e685-4c8c-8586-5f4f6900e02d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:15Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Creating volume a6423e82-e685-4c8c-8586-5f4f6900e02d {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:18 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:18 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d 1073741824 Jul 10 06:46:18 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Flow 'volume_create_manager' (ee6ead99-3320-40f5-9229-d514321fba3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfa3c1b-9c1e-4310-87e6-d3ce32252648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfa3c1b-9c1e-4310-87e6-d3ce32252648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-320775911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8913dba-77a1-4db6-8e84-1063f3f676f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c09f5a7cec4453aada0ad043e47c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:18Z,use_quota=True,user_id='59c0d3eb6c6f4f9e97216e291950843c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ebd0ac-e922-422a-9ff5-440a50ee7db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ebd0ac-e922-422a-9ff5-440a50ee7db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86689e3c-c0df-4008-85a2-0cb734d63f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:18 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:46:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7eb030bc-7b4e-4e69-98af-d5550cbabb3a tempest-GroupSnapshotsTest-76441043 None] group_snapshot 96f1acdc-db3c-4ed4-89b9-6ea6fb3d8d3e: created successfully Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86689e3c-c0df-4008-85a2-0cb734d63f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8913dba-77a1-4db6-8e84-1063f3f676f0', 'volume_name': 'volume-b8913dba-77a1-4db6-8e84-1063f3f676f0', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a852c276-fe5a-4325-9393-3535a573f5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a852c276-fe5a-4325-9393-3535a573f5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44291c87-afd7-42c5-b505-058af0519df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:19 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Volume b8913dba-77a1-4db6-8e84-1063f3f676f0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8913dba-77a1-4db6-8e84-1063f3f676f0', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Trying to clone b8913dba-77a1-4db6-8e84-1063f3f676f0 from image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:46:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] group_snapshot 96f1acdc-db3c-4ed4-89b9-6ea6fb3d8d3e: deleting Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] group_snapshot 96f1acdc-db3c-4ed4-89b9-6ea6fb3d8d3e: deleting {{(pid=86966) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-b708a896-43e8-4379-ba61-4fe2b2690e9c" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-b708a896-43e8-4379-ba61-4fe2b2690e9c" acquired by "delete_snapshot" :: waited 0.075s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-5d591211-7b6d-4a41-a146-40f9da3bbe7c" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-5d591211-7b6d-4a41-a146-40f9da3bbe7c" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Deleting offline snapshot 5d591211-7b6d-4a41-a146-40f9da3bbe7c of volume b708a896-43e8-4379-ba61-4fe2b2690e9c {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] snapshot_file for this snap is: volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbab2a5f-d20f-4bf2-9d59-b265d28fc629]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:20 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d 1073741824" returned: 0 in 1.516s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:20 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d Jul 10 06:46:20 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:20 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c Jul 10 06:46:20 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:20 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:46:20 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Image download 20.69 MB at 20.69 MB/s Jul 10 06:46:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed26c0df-0c5e-471d-b09e-196a2a074f2d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:20 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD Jul 10 06:46:20 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:21 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d" returned: 0 in 1.017s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] <== create_volume: return (2642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.645s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36b6f903-925b-4c17-a80a-1d6a1cc4ead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6423e82-e685-4c8c-8586-5f4f6900e02d', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291f2da3-699d-42f4-8bda-21d197a9ea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:21 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Volume volume-a6423e82-e685-4c8c-8586-5f4f6900e02d (a6423e82-e685-4c8c-8586-5f4f6900e02d): created successfully Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291f2da3-699d-42f4-8bda-21d197a9ea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (c55208a9-4e97-4ec4-8314-f86164644a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:21 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c" returned: 0 in 1.282s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b708a896-43e8-4379-ba61-4fe2b2690e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10beea1-98a0-44ba-8327-19c3869d907d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4386a078-9fdf-4a75-a0d1-edd21041cc36 tempest-VolumesActionsTest-1176695170 None] Created volume successfully. Jul 10 06:46:21 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c Jul 10 06:46:21 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:21 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD" returned: 0 in 1.219s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Temporary image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 is fetched for user 59c0d3eb6c6f4f9e97216e291950843c. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a81713a-1820-4579-affd-fa09052e473d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:21 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD Jul 10 06:46:21 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34e7386d-8f30-4f6e-a86a-e7d2ff91aa04 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d" by "attach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34e7386d-8f30-4f6e-a86a-e7d2ff91aa04 tempest-VolumesActionsTest-1176695170 None] Lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d" acquired by "attach_volume" :: waited 0.056s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-34e7386d-8f30-4f6e-a86a-e7d2ff91aa04 tempest-VolumesActionsTest-1176695170 None] Attaching volume a6423e82-e685-4c8c-8586-5f4f6900e02d to instance d85e45da-8420-41d0-995e-b69761f1dae5 at mountpoint /dev/vdb on host None. Jul 10 06:46:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-34e7386d-8f30-4f6e-a86a-e7d2ff91aa04 tempest-VolumesActionsTest-1176695170 None] Attach volume completed successfully. Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-34e7386d-8f30-4f6e-a86a-e7d2ff91aa04 tempest-VolumesActionsTest-1176695170 None] Lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d" released by "attach_volume" :: held 0.201s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:22 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c" returned: 0 in 1.083s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:22 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c Jul 10 06:46:22 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:22 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD" returned: 0 in 1.134s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-320775911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8913dba-77a1-4db6-8e84-1063f3f676f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c09f5a7cec4453aada0ad043e47c6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:18Z,use_quota=True,user_id='59c0d3eb6c6f4f9e97216e291950843c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Creating volume b8913dba-77a1-4db6-8e84-1063f3f676f0 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:22 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:46:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:22 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 1073741824 Jul 10 06:46:22 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:23 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c" returned: 0 in 1.086s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:23 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c Jul 10 06:46:23 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-aa376ba3-9035-4ac9-b088-0edb3ab48b90 tempest-VolumesActionsTest-680560106 None] Terminate volume connection completed successfully. Jul 10 06:46:23 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 1073741824" returned: 0 in 1.101s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aa376ba3-9035-4ac9-b088-0edb3ab48b90 tempest-VolumesActionsTest-680560106 None] Acquiring lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d-detach_volume" by "detach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aa376ba3-9035-4ac9-b088-0edb3ab48b90 tempest-VolumesActionsTest-680560106 None] Lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d-detach_volume" acquired by "detach_volume" :: waited 0.058s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:24 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 Jul 10 06:46:24 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-aa376ba3-9035-4ac9-b088-0edb3ab48b90 tempest-VolumesActionsTest-680560106 None] Detaching volume a6423e82-e685-4c8c-8586-5f4f6900e02d from instance d85e45da-8420-41d0-995e-b69761f1dae5. Jul 10 06:46:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-aa376ba3-9035-4ac9-b088-0edb3ab48b90 tempest-VolumesActionsTest-680560106 None] Detach volume completed successfully. Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aa376ba3-9035-4ac9-b088-0edb3ab48b90 tempest-VolumesActionsTest-680560106 None] Lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:24 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c.5d591211-7b6d-4a41-a146-40f9da3bbe7c" returned: 0 in 0.878s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-5d591211-7b6d-4a41-a146-40f9da3bbe7c" released by "_delete_snapshot" :: held 4.509s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-b708a896-43e8-4379-ba61-4fe2b2690e9c" released by "delete_snapshot" :: held 4.563s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-b781c9ed-3ae1-421f-843e-5fd1002c9725" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-b781c9ed-3ae1-421f-843e-5fd1002c9725" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-cc208dbf-8b2d-4f47-979d-7f7b729ebce4" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-cc208dbf-8b2d-4f47-979d-7f7b729ebce4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Deleting offline snapshot cc208dbf-8b2d-4f47-979d-7f7b729ebce4 of volume b781c9ed-3ae1-421f-843e-5fd1002c9725 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] snapshot_file for this snap is: volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[634ce0c2-a757-4fc9-adab-cfe592a963e3]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:24 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 Jul 10 06:46:24 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-09c40223-75fe-48b7-9c3f-7bf679552d6e tempest-VolumesActionsTest-1176695170 None] Acquiring lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d-detach_volume" by "detach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-09c40223-75fe-48b7-9c3f-7bf679552d6e tempest-VolumesActionsTest-1176695170 None] Lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-09c40223-75fe-48b7-9c3f-7bf679552d6e tempest-VolumesActionsTest-1176695170 None] Volume detach called, but volume not attached. Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-09c40223-75fe-48b7-9c3f-7bf679552d6e tempest-VolumesActionsTest-1176695170 None] Lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:24 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0" returned: 0 in 0.762s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Attempting download of 3a4cb804-6b6d-41c8-ac4c-b431983d3649 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}])) to volume b8913dba-77a1-4db6-8e84-1063f3f676f0. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f17fff-1c06-4f4c-b043-e52287992677]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_ado0kfg6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:25 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_ado0kfg6 Jul 10 06:46:25 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:25 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b781c9ed-3ae1-421f-843e-5fd1002c9725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[daba58a5-4ee5-41d1-8850-ca34c48a016a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Acquiring lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Acquiring lock "cinder-quobyte-a6423e82-e685-4c8c-8586-5f4f6900e02d" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Lock "cinder-quobyte-a6423e82-e685-4c8c-8586-5f4f6900e02d" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:25 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 Jul 10 06:46:25 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac4423f-67d5-4281-b68b-0980128ccd0f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:25 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d Jul 10 06:46:25 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:25 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_ado0kfg6" returned: 0 in 0.802s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_ado0kfg6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:25 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_ado0kfg6 Jul 10 06:46:25 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:26 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725" returned: 0 in 0.909s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:26 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 Jul 10 06:46:26 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:26 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d" returned: 0 in 0.804s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:26 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d Jul 10 06:46:26 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:26 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_ado0kfg6" returned: 1 in 0.909s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_ado0kfg6' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:46:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfea6015-66ae-4bc3-aebd-eb76fb09aabe]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:26 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD Jul 10 06:46:26 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:27 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a6423e82-e685-4c8c-8586-5f4f6900e02d" returned: 0 in 0.777s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Lock "cinder-quobyte-a6423e82-e685-4c8c-8586-5f4f6900e02d" released by "delete_volume" :: held 1.634s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:27 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4" returned: 0 in 0.894s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:27 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4 Jul 10 06:46:27 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Created reservations ['9942a004-7701-451b-a091-d10b8e1b9e93', '7a9ba26f-3036-4014-ac9d-0f123acd8de6', 'c2a3b481-66f3-4973-b853-154a68af5e35', 'ffc7be1e-ed26-448d-aab5-edd7b6985d93'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:27 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:27 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:27 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD" returned: 0 in 0.873s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] 3a4cb804-6b6d-41c8-ac4c-b431983d3649 was qcow2, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:46:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:27 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 Jul 10 06:46:27 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:28 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725.cc208dbf-8b2d-4f47-979d-7f7b729ebce4" returned: 0 in 0.950s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-cc208dbf-8b2d-4f47-979d-7f7b729ebce4" released by "_delete_snapshot" :: held 3.789s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-b781c9ed-3ae1-421f-843e-5fd1002c9725" released by "delete_snapshot" :: held 3.833s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:28 devstack cinder-volume[86966]: WARNING cinder.quota [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-929736148 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-929736148, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:46:28 devstack cinder-volume[86966]: WARNING cinder.quota [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-929736148 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-929736148, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:46:28 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.159s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:28 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:28 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Created reservations ['4a0550a4-370b-4533-9d2c-e0be6b3382ff', 'c0130e6e-d93e-4349-b0b7-bedf8bbc8bcf', 'b337868d-9628-4ff0-8256-6aa68b15a107', '7efd7044-1693-456b-9bb7-e62c179fa8e7'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Deleted volume successfully. Jul 10 06:46:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-de501368-59a3-4cd4-bb5e-95874c27168d tempest-VolumesActionsTest-1176695170 None] Lock "cinder-a6423e82-e685-4c8c-8586-5f4f6900e02d-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:28 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] Created reservations ['5042cf88-ad3a-424d-b834-d159b4bda057', 'b66691be-2ce2-4e90-bf36-91582509547c', 'd07eea0b-ef5b-426d-97e2-44d5256b677c', '741533c6-4b53-4f0a-9bbf-24efe9b48514'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-582209a7-bd48-4c68-89d8-d4e97385aab8 tempest-GroupSnapshotsTest-76441043 None] group_snapshot 96f1acdc-db3c-4ed4-89b9-6ea6fb3d8d3e: deleted successfully Jul 10 06:46:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-b708a896-43e8-4379-ba61-4fe2b2690e9c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-b708a896-43e8-4379-ba61-4fe2b2690e9c" acquired by "delete_volume" :: waited 0.045s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:30 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dffa629-8141-4a65-9e6b-9aa200360a0c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:30 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c Jul 10 06:46:30 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:30 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0" returned: 0 in 3.268s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:30 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_rzqry1oidevstack@QuobyteHD, size 112.00 MB, duration 3.27 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:46:30 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Converted 112.00 MB image at 34.26 MB/s Jul 10 06:46:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:30 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 1G Jul 10 06:46:30 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:31 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 1G" returned: 0 in 0.856s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:31 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cc32f7-6b15-4498-b95c-be49191032c2]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c" returned: 0 in 1.084s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:31 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c Jul 10 06:46:31 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:31 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 Jul 10 06:46:31 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:32 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b708a896-43e8-4379-ba61-4fe2b2690e9c" returned: 0 in 0.763s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-b708a896-43e8-4379-ba61-4fe2b2690e9c" released by "delete_volume" :: held 1.980s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-b781c9ed-3ae1-421f-843e-5fd1002c9725" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-b781c9ed-3ae1-421f-843e-5fd1002c9725" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[541988dc-ae6d-4fac-9ee2-fb20826e1d24]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:32 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0" returned: 0 in 0.900s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:32 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 Jul 10 06:46:32 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:32 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 Jul 10 06:46:32 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:33 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0" returned: 1 in 1.078s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Downloaded image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}])) to volume b8913dba-77a1-4db6-8e84-1063f3f676f0 successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Temporary image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 for user 59c0d3eb6c6f4f9e97216e291950843c is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Marking volume b8913dba-77a1-4db6-8e84-1063f3f676f0 as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=128,cinder:INSERT=31,cinder:UPDATE=136,cinder:DELETE=11 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Copying metadata from image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 to b8913dba-77a1-4db6-8e84-1063f3f676f0. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Creating volume glance metadata for volume b8913dba-77a1-4db6-8e84-1063f3f676f0 backed by image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=113,cinder:INSERT=36,cinder:UPDATE=141,cinder:DELETE=3 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:46:33 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725" returned: 0 in 1.286s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:33 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725 Jul 10 06:46:33 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44291c87-afd7-42c5-b505-058af0519df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8913dba-77a1-4db6-8e84-1063f3f676f0', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a2bba4-301a-4072-a761-92678e2ce8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Volume volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 (b8913dba-77a1-4db6-8e84-1063f3f676f0): created successfully Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a2bba4-301a-4072-a761-92678e2ce8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Flow 'volume_create_manager' (ee6ead99-3320-40f5-9229-d514321fba3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-59902b95-24b3-4857-bb45-4d9817dd9616 tempest-VolumesImageMetadata-1580877987 None] Created volume successfully. Jul 10 06:46:34 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b781c9ed-3ae1-421f-843e-5fd1002c9725" returned: 0 in 0.963s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-b781c9ed-3ae1-421f-843e-5fd1002c9725" released by "delete_volume" :: held 2.318s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:34 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Created reservations ['cd00a138-5630-4d35-a61c-cf5a8f8d0008'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:35 devstack cinder-volume[86966]: WARNING cinder.quota [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-929736148 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-929736148, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Created reservations ['ee6e3516-4a02-40db-a536-d9634bb273fc', 'a49eef9e-660d-4e93-9c28-4523e519caf4', '301cbf75-93c3-41db-8012-e0c98911788c', '2dedd5d5-cbaf-4e2b-bdc2-26ab93f6d682'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Created reservations ['6c0a6f86-925e-4370-8cc9-c1af8974cafc', '83d6e980-73d5-43e1-b98e-0c780483e9ff', '70733536-d28d-4805-8213-265b6c7f2a58', '360f70a2-87ea-41a8-8511-eb2597a481e1'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:35 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:35 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Acquiring lock "cinder-b8913dba-77a1-4db6-8e84-1063f3f676f0-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Lock "cinder-b8913dba-77a1-4db6-8e84-1063f3f676f0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Acquiring lock "cinder-quobyte-b8913dba-77a1-4db6-8e84-1063f3f676f0" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Lock "cinder-quobyte-b8913dba-77a1-4db6-8e84-1063f3f676f0" acquired by "delete_volume" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4174989-1e8a-4e75-a132-d88741207f06]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (b0bf90b2-1065-492d-b12b-03c774d6818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811cf321-d830-4df5-8bf5-c32210d4016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:35 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 Jul 10 06:46:35 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811cf321-d830-4df5-8bf5-c32210d4016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-466007948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146fe115-9c4c-4544-90fb-e96052b97d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:36Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e6478e-9c5d-46c1-a564-164b817bb5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e6478e-9c5d-46c1-a564-164b817bb5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8530cf0-2d12-4577-9dc1-49733b5eeda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8530cf0-2d12-4577-9dc1-49733b5eeda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146fe115-9c4c-4544-90fb-e96052b97d0e', 'volume_name': 'volume-146fe115-9c4c-4544-90fb-e96052b97d0e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3b86fc-8014-46b5-90cb-c04fb959fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3b86fc-8014-46b5-90cb-c04fb959fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed47022c-844b-4850-a404-c187cc24ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:36 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Volume 146fe115-9c4c-4544-90fb-e96052b97d0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146fe115-9c4c-4544-90fb-e96052b97d0e', 'volume_size': 1} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-466007948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146fe115-9c4c-4544-90fb-e96052b97d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:36Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Creating volume 146fe115-9c4c-4544-90fb-e96052b97d0e {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:36 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:36 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e 1073741824 Jul 10 06:46:36 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:36 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.945s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cea8f88b-fd2f-4a56-bd75-869d050132ff tempest-GroupSnapshotsTest-76441043 None] Delete group completed successfully. Jul 10 06:46:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-62f60a2b-32f1-4a52-b4c1-3da3aa90b90d tempest-GroupSnapshotsTest-76441043 None] Group tempest-GroupSnapshotsTest-Group-874753973: creating Jul 10 06:46:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-62f60a2b-32f1-4a52-b4c1-3da3aa90b90d tempest-GroupSnapshotsTest-76441043 None] Group tempest-GroupSnapshotsTest-Group-874753973: created successfully Jul 10 06:46:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-62f60a2b-32f1-4a52-b4c1-3da3aa90b90d tempest-GroupSnapshotsTest-76441043 None] Create group completed successfully. Jul 10 06:46:36 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0" returned: 0 in 1.180s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:36 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 Jul 10 06:46:36 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:37 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e 1073741824" returned: 0 in 1.135s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:37 devstack sudo[93997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e Jul 10 06:46:37 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:37 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0" returned: 1 in 1.072s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:46:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:37 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0 Jul 10 06:46:37 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:38 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e" returned: 0 in 0.957s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed47022c-844b-4850-a404-c187cc24ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146fe115-9c4c-4544-90fb-e96052b97d0e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276a958c-390f-4eca-a878-b8be7ca8c9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:38 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Volume volume-146fe115-9c4c-4544-90fb-e96052b97d0e (146fe115-9c4c-4544-90fb-e96052b97d0e): created successfully Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276a958c-390f-4eca-a878-b8be7ca8c9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (b0bf90b2-1065-492d-b12b-03c774d6818e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e2e1063b-57a6-451f-ad88-d0e3b7be4139 tempest-VolumesActionsTest-1176695170 None] Created volume successfully. Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Flow 'volume_create_manager' (1d73cd45-6d62-4567-9650-ae8d8fc68e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795ac1a3-35a7-496c-8067-58fedab447e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795ac1a3-35a7-496c-8067-58fedab447e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1999319177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb4fc951-4bd1-4261-9d0a-cfd4356b9fe4,host='devstack@QuobyteHD#QuobyteHD',id=fa734b62-bf64-479b-b88d-b22fe669ad60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d00561cbac4b31932b4e1d487b2c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:39Z,use_quota=True,user_id='2339c8232f0f48f084dee6ea9dfc44c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bec8b32e-3dcb-4cb9-b954-686086928c23),volume_type_id=bec8b32e-3dcb-4cb9-b954-686086928c23)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9075d41-7a3a-46b7-bba7-20aa24ab01c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9075d41-7a3a-46b7-bba7-20aa24ab01c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4134ad68-6114-48d9-9d42-d09218ad4723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4134ad68-6114-48d9-9d42-d09218ad4723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa734b62-bf64-479b-b88d-b22fe669ad60', 'volume_name': 'volume-fa734b62-bf64-479b-b88d-b22fe669ad60', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f2ac66-4a97-4763-8933-4d9907a07fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f2ac66-4a97-4763-8933-4d9907a07fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364e35a7-735d-41df-922f-c15aa104f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:38 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Volume fa734b62-bf64-479b-b88d-b22fe669ad60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa734b62-bf64-479b-b88d-b22fe669ad60', 'volume_size': 1} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb4fc951-4bd1-4261-9d0a-cfd4356b9fe4,created_at=2026-07-10T04:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1999319177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb4fc951-4bd1-4261-9d0a-cfd4356b9fe4,host='devstack@QuobyteHD#QuobyteHD',id=fa734b62-bf64-479b-b88d-b22fe669ad60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17d00561cbac4b31932b4e1d487b2c35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:39Z,use_quota=True,user_id='2339c8232f0f48f084dee6ea9dfc44c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bec8b32e-3dcb-4cb9-b954-686086928c23),volume_type_id=bec8b32e-3dcb-4cb9-b954-686086928c23)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Creating volume fa734b62-bf64-479b-b88d-b22fe669ad60 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:38 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:38 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 1073741824 Jul 10 06:46:38 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:38 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8913dba-77a1-4db6-8e84-1063f3f676f0" returned: 0 in 0.942s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Lock "cinder-quobyte-b8913dba-77a1-4db6-8e84-1063f3f676f0" released by "delete_volume" :: held 3.335s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Created reservations ['0c7c05de-291e-4ded-b1b4-a51406f2b04b', 'c5005761-8e73-464a-855b-dae96cd14ebd', 'd4ac0ece-4e4d-4e1f-99a5-d46a531fbb4c', '7e090769-a822-453e-a5c6-c78463e8a03b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Acquiring lock "cinder-146fe115-9c4c-4544-90fb-e96052b97d0e-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:39 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:39 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Lock "cinder-146fe115-9c4c-4544-90fb-e96052b97d0e-delete_volume" acquired by "delete_volume" :: waited 0.171s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Acquiring lock "cinder-quobyte-146fe115-9c4c-4544-90fb-e96052b97d0e" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Lock "cinder-quobyte-146fe115-9c4c-4544-90fb-e96052b97d0e" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d138a45-0a14-48e2-85c9-152d6e99e142]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:39 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e Jul 10 06:46:39 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:40 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 1073741824" returned: 0 in 1.700s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:40 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 Jul 10 06:46:40 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:40 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.312s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:40 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Deleted volume successfully. Jul 10 06:46:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-95e6c991-1302-4139-982b-fb6957149b6f tempest-VolumesImageMetadata-1580877987 None] Lock "cinder-b8913dba-77a1-4db6-8e84-1063f3f676f0-delete_volume" released by "delete_volume" :: held 5.184s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:41 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e" returned: 0 in 1.495s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:41 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e Jul 10 06:46:41 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:42 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60" returned: 0 in 1.596s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] <== create_volume: return (3414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.419s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364e35a7-735d-41df-922f-c15aa104f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa734b62-bf64-479b-b88d-b22fe669ad60', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed8ffaa-3598-457c-afeb-e1239dce8e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Volume volume-fa734b62-bf64-479b-b88d-b22fe669ad60 (fa734b62-bf64-479b-b88d-b22fe669ad60): created successfully Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed8ffaa-3598-457c-afeb-e1239dce8e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Flow 'volume_create_manager' (1d73cd45-6d62-4567-9650-ae8d8fc68e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-df81c115-e46d-497c-b0cf-8d04c9425028 tempest-GroupSnapshotsTest-76441043 None] Created volume successfully. Jul 10 06:46:42 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-146fe115-9c4c-4544-90fb-e96052b97d0e" returned: 0 in 1.407s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Lock "cinder-quobyte-146fe115-9c4c-4544-90fb-e96052b97d0e" released by "delete_volume" :: held 2.992s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Created reservations ['cc4b1107-668f-4f0e-80e1-d15c87594e3f', 'a6f9ed8c-4179-4cd1-a388-c7b0defa8275', '833de04b-2574-4ffd-a424-3e4b1bc77d06', '53fd224a-36ad-469c-a5ee-922e85bc2d86'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:42 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:42 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] GroupSnapshot 1a381d24-e9c3-4b7d-bdcf-703fe1423076: creating. Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] Group snapshot 1a381d24-e9c3-4b7d-bdcf-703fe1423076: creating. {{(pid=86966) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] Creating offline snapshot ed1f1100-210a-4c5b-9a37-3251c4ef55ae of volume fa734b62-bf64-479b-b88d-b22fe669ad60 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:46:43 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c0558-9c87-4ecb-9375-33d9b323de09]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:43 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 Jul 10 06:46:43 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:44 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60" returned: 0 in 1.291s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:44 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.604s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:44 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae 1G Jul 10 06:46:44 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (e5d792b2-832a-4f1f-a8b8-5463518bbd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a9bea7-28b2-4fc8-bcc9-8e13c6c63ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Deleted volume successfully. Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a9bea7-28b2-4fc8-bcc9-8e13c6c63ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519830160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ca68ba-e5da-410e-a05d-fa1a6bb73f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:44Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6449cc-f0b0-458a-8b89-3d0657fb90ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6449cc-f0b0-458a-8b89-3d0657fb90ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe97f44-59a1-4cab-a3c3-daacf311b421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe97f44-59a1-4cab-a3c3-daacf311b421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58ca68ba-e5da-410e-a05d-fa1a6bb73f44', 'volume_name': 'volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c36c65b-563a-482f-b2e7-bca8b3ff1079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c36c65b-563a-482f-b2e7-bca8b3ff1079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38247eff-1a19-4735-8d82-04af44d86957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Volume 58ca68ba-e5da-410e-a05d-fa1a6bb73f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44', 'volume_size': 1} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7247fbb9-3b55-4691-998d-d98b5d690d42 tempest-VolumesActionsTest-680560106 None] Lock "cinder-146fe115-9c4c-4544-90fb-e96052b97d0e-delete_volume" released by "delete_volume" :: held 5.258s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:45 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae 1G" returned: 0 in 1.058s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa734b62-bf64-479b-b88d-b22fe669ad60 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:45 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa734b62-bf64-479b-b88d-b22fe669ad60 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae Jul 10 06:46:45 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Flow 'volume_create_manager' (c21a94d0-75c8-43f7-b664-cbeccddd69ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ea30c8-3bb0-4c83-b88b-051d562ee5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ea30c8-3bb0-4c83-b88b-051d562ee5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-179371812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68217b11-e965-4883-9fe2-e9de97ea08ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ca91a8e67f545bf8e7c43c73592abf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:46Z,use_quota=True,user_id='b5879d5e1ea049e9908b820ebc41e7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9842ae-106a-4fa6-8efd-3ea8385e5316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9842ae-106a-4fa6-8efd-3ea8385e5316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6bf17b-8757-47d1-829f-74e71cce5c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6bf17b-8757-47d1-829f-74e71cce5c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68217b11-e965-4883-9fe2-e9de97ea08ee', 'volume_name': 'volume-68217b11-e965-4883-9fe2-e9de97ea08ee', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a2f466-829f-467c-97c8-83b4de2791cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a2f466-829f-467c-97c8-83b4de2791cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f411df26-efcd-4ec5-b60f-f712b8e8b70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Volume 68217b11-e965-4883-9fe2-e9de97ea08ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68217b11-e965-4883-9fe2-e9de97ea08ee', 'volume_size': 1} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:46 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa734b62-bf64-479b-b88d-b22fe669ad60 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae" returned: 0 in 0.820s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:46 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:46 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae Jul 10 06:46:46 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:46 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae" returned: 0 in 0.680s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:46 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.info Jul 10 06:46:46 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:47 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.info" returned: 0 in 0.680s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:47 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:46:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:47 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.info Jul 10 06:46:47 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:48 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.info" returned: 0 in 0.676s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.352s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.639s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-519830160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ca68ba-e5da-410e-a05d-fa1a6bb73f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:44Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Creating volume 58ca68ba-e5da-410e-a05d-fa1a6bb73f44 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:48 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:46:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:48 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44 1073741824 Jul 10 06:46:48 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6895ab84-e131-4070-9b96-a232e993b1d4 tempest-GroupSnapshotsTest-76441043 None] group_snapshot 1a381d24-e9c3-4b7d-bdcf-703fe1423076: created successfully Jul 10 06:46:49 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44 1073741824" returned: 0 in 0.941s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:49 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44 Jul 10 06:46:49 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] group_snapshot 1a381d24-e9c3-4b7d-bdcf-703fe1423076: deleting Jul 10 06:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] group_snapshot 1a381d24-e9c3-4b7d-bdcf-703fe1423076: deleting {{(pid=86966) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 06:46:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-fa734b62-bf64-479b-b88d-b22fe669ad60" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-fa734b62-bf64-479b-b88d-b22fe669ad60" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-ed1f1100-210a-4c5b-9a37-3251c4ef55ae" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-ed1f1100-210a-4c5b-9a37-3251c4ef55ae" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Deleting offline snapshot ed1f1100-210a-4c5b-9a37-3251c4ef55ae of volume fa734b62-bf64-479b-b88d-b22fe669ad60 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:46:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] snapshot_file for this snap is: volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:46:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[782bff1d-9b74-441d-862c-5053921e276b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:49 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae Jul 10 06:46:49 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:50 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44" returned: 0 in 0.709s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.813s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-179371812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68217b11-e965-4883-9fe2-e9de97ea08ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ca91a8e67f545bf8e7c43c73592abf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:46Z,use_quota=True,user_id='b5879d5e1ea049e9908b820ebc41e7fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Creating volume 68217b11-e965-4883-9fe2-e9de97ea08ee {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:50 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:50 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee 1073741824 Jul 10 06:46:50 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38247eff-1a19-4735-8d82-04af44d86957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3f0712-727c-4937-b431-cf5e3f5a51c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:50 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Volume volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44 (58ca68ba-e5da-410e-a05d-fa1a6bb73f44): created successfully Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3f0712-727c-4937-b431-cf5e3f5a51c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (e5d792b2-832a-4f1f-a8b8-5463518bbd44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ff6d5361-f094-4f57-b67a-5cde00041f41 tempest-VolumesActionsTest-1176695170 None] Created volume successfully. Jul 10 06:46:50 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae" returned: 0 in 0.831s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa734b62-bf64-479b-b88d-b22fe669ad60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb5fa01-7489-4987-a41f-5ea0089fda57]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:50 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 Jul 10 06:46:50 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:50 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Acquiring lock "cinder-58ca68ba-e5da-410e-a05d-fa1a6bb73f44-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee 1073741824" returned: 0 in 0.944s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Lock "cinder-58ca68ba-e5da-410e-a05d-fa1a6bb73f44-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Acquiring lock "cinder-quobyte-58ca68ba-e5da-410e-a05d-fa1a6bb73f44" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:51 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee Jul 10 06:46:51 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Lock "cinder-quobyte-58ca68ba-e5da-410e-a05d-fa1a6bb73f44" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa3f34d-9aa0-482d-bc27-952165e9631e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:51 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44 Jul 10 06:46:51 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:51 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60" returned: 0 in 0.888s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:51 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae Jul 10 06:46:51 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:51 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f411df26-efcd-4ec5-b60f-f712b8e8b70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68217b11-e965-4883-9fe2-e9de97ea08ee', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596f0215-129c-4856-ac68-3f3f8c9628bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:51 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Volume volume-68217b11-e965-4883-9fe2-e9de97ea08ee (68217b11-e965-4883-9fe2-e9de97ea08ee): created successfully Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596f0215-129c-4856-ac68-3f3f8c9628bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Flow 'volume_create_manager' (c21a94d0-75c8-43f7-b664-cbeccddd69ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9febcdbf-654d-4d5f-8f1b-8efdd7b820cc tempest-VolumesMetadataTest-1310508243 None] Created volume successfully. Jul 10 06:46:51 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44" returned: 0 in 0.818s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:51 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44 Jul 10 06:46:51 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:52 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae" returned: 0 in 0.803s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:52 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae Jul 10 06:46:52 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:52 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58ca68ba-e5da-410e-a05d-fa1a6bb73f44" returned: 0 in 0.785s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Lock "cinder-quobyte-58ca68ba-e5da-410e-a05d-fa1a6bb73f44" released by "delete_volume" :: held 1.648s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:52 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Created reservations ['c7a901bc-bd87-4289-8091-e902dee36997', 'f9051baa-0480-4c66-873f-b897c621a069', '3678310e-81fc-4f3d-8051-5703cf680347', '997c209f-bdc8-4a56-b403-3c73b3d357e0'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:52 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:52 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:53 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60.ed1f1100-210a-4c5b-9a37-3251c4ef55ae" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-ed1f1100-210a-4c5b-9a37-3251c4ef55ae" released by "_delete_snapshot" :: held 3.411s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-fa734b62-bf64-479b-b88d-b22fe669ad60" released by "delete_snapshot" :: held 3.437s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Acquiring lock "cinder-68217b11-e965-4883-9fe2-e9de97ea08ee-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Lock "cinder-68217b11-e965-4883-9fe2-e9de97ea08ee-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:53 devstack cinder-volume[86966]: WARNING cinder.quota [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-597531168 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-597531168, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:46:53 devstack cinder-volume[86966]: WARNING cinder.quota [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-597531168 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-597531168, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Acquiring lock "cinder-quobyte-68217b11-e965-4883-9fe2-e9de97ea08ee" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] Created reservations ['4ee6d878-d937-4b63-857d-813c050a469a', 'bd340c39-b58e-4a86-8273-2aaf700f585c', 'cf3103c4-cafa-4ed0-91da-0104abd3f36c', 'fbc6d8f2-e1c1-4c77-ac27-5aa0388d4e24'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Lock "cinder-quobyte-68217b11-e965-4883-9fe2-e9de97ea08ee" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7426164a-0fe4-41ea-b4f9-3c57d39c4e37]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-932b192d-e615-44eb-9c4a-dd017d5c6f13 tempest-GroupSnapshotsTest-76441043 None] group_snapshot 1a381d24-e9c3-4b7d-bdcf-703fe1423076: deleted successfully Jul 10 06:46:53 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee Jul 10 06:46:53 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:53 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.756s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Deleted volume successfully. Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b79c6e24-df7f-4fe7-91c2-90c727e0e67d tempest-VolumesActionsTest-680560106 None] Lock "cinder-58ca68ba-e5da-410e-a05d-fa1a6bb73f44-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (dd77a576-a3de-4792-9534-3b86e1a96eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0041f245-0c0e-48a5-8166-b1a34b73a4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0041f245-0c0e-48a5-8166-b1a34b73a4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1772581135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:54Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ebcfe0-fc6e-47dd-826f-d5cdda67b220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ebcfe0-fc6e-47dd-826f-d5cdda67b220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ef9735-e42a-4d38-9c66-401357047541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ef9735-e42a-4d38-9c66-401357047541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea', 'volume_name': 'volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6347fa74-0938-412c-931c-cb2d50129efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6347fa74-0938-412c-931c-cb2d50129efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb03915-4dca-49b3-8d42-259379ab8b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Volume 5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea', 'volume_size': 1} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1772581135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:54Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Creating volume 5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:53 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:46:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:53 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea 1073741824 Jul 10 06:46:53 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:54 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee" returned: 0 in 0.993s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:54 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee Jul 10 06:46:54 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "cinder-quobyte-fa734b62-bf64-479b-b88d-b22fe669ad60" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-fa734b62-bf64-479b-b88d-b22fe669ad60" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e020f35f-2591-4611-ae49-a30f1436e7de]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:54 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 Jul 10 06:46:54 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:54 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea 1073741824" returned: 0 in 1.017s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:55 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea Jul 10 06:46:55 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:55 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-68217b11-e965-4883-9fe2-e9de97ea08ee" returned: 0 in 0.794s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Lock "cinder-quobyte-68217b11-e965-4883-9fe2-e9de97ea08ee" released by "delete_volume" :: held 1.838s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Created reservations ['ee6d65e7-f7a5-40d3-9a68-2a055d7dd85e', '197aa042-6bc4-44b7-aa82-a9041f4a4710', '2fe5fd1e-27ab-408d-92bb-77c61452c938', '039efba5-2aad-4794-902c-2a66d93361ed'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:55 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:55 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:55 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60" returned: 0 in 0.949s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:55 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60 Jul 10 06:46:55 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:55 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea" returned: 0 in 0.816s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb03915-4dca-49b3-8d42-259379ab8b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41dc7bfc-f8b7-4a36-94f2-ef0c8d1b8518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:55 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Volume volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea (5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea): created successfully Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41dc7bfc-f8b7-4a36-94f2-ef0c8d1b8518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (dd77a576-a3de-4792-9534-3b86e1a96eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-af32f0a0-19e7-4485-835b-3c68ec66a7e8 tempest-VolumesActionsTest-1176695170 None] Created volume successfully. Jul 10 06:46:56 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:56 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.004s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fa734b62-bf64-479b-b88d-b22fe669ad60" returned: 0 in 0.851s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Deleted volume successfully. Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Lock "cinder-quobyte-fa734b62-bf64-479b-b88d-b22fe669ad60" released by "delete_volume" :: held 1.875s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c98544ad-0b4e-49b6-9b07-7139d85ff001 tempest-VolumesMetadataTest-1310508243 None] Lock "cinder-68217b11-e965-4883-9fe2-e9de97ea08ee-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Created reservations ['061ccd8e-e4c7-4494-bd64-7488ddf934e9'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:56 devstack cinder-volume[86966]: WARNING cinder.quota [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-597531168 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-597531168, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Created reservations ['31e71c8a-1a32-4c14-8876-ca17961b346c', 'a62d0014-393b-4ada-ba93-2de95706cec6', '088aaee3-bce4-4a8a-9b42-af68f66b11ff', '6cf29c79-8846-4ef5-b47e-4dfb619c7c92'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:56 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:56 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Acquiring lock "cinder-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Lock "cinder-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Acquiring lock "cinder-quobyte-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Lock "cinder-quobyte-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[840d279f-c078-410a-83b3-daa1b5ec1f78]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:57 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea Jul 10 06:46:57 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:57 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.207s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:57 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7efd0a50-89cd-4426-9aa0-846bf60e61c0 tempest-GroupSnapshotsTest-76441043 None] Delete group completed successfully. Jul 10 06:46:58 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea" returned: 0 in 0.959s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:58 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea Jul 10 06:46:58 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:59 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea" returned: 0 in 0.854s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Lock "cinder-quobyte-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea" released by "delete_volume" :: held 1.889s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:59 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Created reservations ['8ca46af3-03e5-40f2-b37b-c5af182770d9', '2de4eac1-75a3-45c9-a48c-932c42852dd9', '2435913f-551e-4241-921c-548ab647e050', '6d9beca8-e11b-49a3-87a8-439eb26d4101'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:59 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:46:59 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:00 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.880s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Deleted volume successfully. Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6ab4b0b5-265c-4933-bb36-44b6142495d4 tempest-VolumesActionsTest-680560106 None] Lock "cinder-5a5af816-2fcd-46ea-9bd4-17a8a9ae36ea-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (540bd2bc-f1cb-4d5d-9b57-1848395a6c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2eb6ae2-5515-46ac-8550-cd61353b4917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2eb6ae2-5515-46ac-8550-cd61353b4917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-977748356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3715c9-5f10-49aa-8db8-00ea1e970f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:00Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ca85e4-9eef-4449-a3ad-4ae0724006d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ca85e4-9eef-4449-a3ad-4ae0724006d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61f3a3a-a7c3-408e-94d8-82daa0fb411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61f3a3a-a7c3-408e-94d8-82daa0fb411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3715c9-5f10-49aa-8db8-00ea1e970f1e', 'volume_name': 'volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2860b6f6-a67a-4032-a6f8-691e101e47cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2860b6f6-a67a-4032-a6f8-691e101e47cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e127140e-7024-497a-8340-d3f512d5e98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:00 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Volume 9e3715c9-5f10-49aa-8db8-00ea1e970f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e', 'volume_size': 1} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-977748356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3715c9-5f10-49aa-8db8-00ea1e970f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:00Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Creating volume 9e3715c9-5f10-49aa-8db8-00ea1e970f1e {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:00 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:00 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e 1073741824 Jul 10 06:47:00 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:01 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e 1073741824" returned: 0 in 1.107s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:01 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e Jul 10 06:47:01 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Flow 'volume_create_manager' (d34bde76-9f9f-4d90-9c38-0ad2c894c155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13bea916-2ad4-42e4-a93a-7642226de770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13bea916-2ad4-42e4-a93a-7642226de770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-790875131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef05296-485f-40aa-ba2c-cb237f1be536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c95117f41a04618aa08429fb2391e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:02Z,use_quota=True,user_id='75dbbbd749844478a002d267682cabf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef107140-a15a-48f1-813e-b6507e2f5d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef107140-a15a-48f1-813e-b6507e2f5d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44a695-b91f-427e-8d5b-e8a66afe2656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44a695-b91f-427e-8d5b-e8a66afe2656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef05296-485f-40aa-ba2c-cb237f1be536', 'volume_name': 'volume-7ef05296-485f-40aa-ba2c-cb237f1be536', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4736c7d5-a42f-4c6c-905a-a26345c34110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4736c7d5-a42f-4c6c-905a-a26345c34110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088c662c-2b98-4471-af22-99d0ba3fa163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Volume 7ef05296-485f-40aa-ba2c-cb237f1be536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef05296-485f-40aa-ba2c-cb237f1be536', 'volume_size': 1} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:02 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e" returned: 0 in 0.939s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.263s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-790875131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef05296-485f-40aa-ba2c-cb237f1be536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c95117f41a04618aa08429fb2391e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:02Z,use_quota=True,user_id='75dbbbd749844478a002d267682cabf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Creating volume 7ef05296-485f-40aa-ba2c-cb237f1be536 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:02 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e127140e-7024-497a-8340-d3f512d5e98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:02 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536 1073741824 Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db36f95-a949-4de8-9933-a62d970d0bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:02 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Volume volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e (9e3715c9-5f10-49aa-8db8-00ea1e970f1e): created successfully Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db36f95-a949-4de8-9933-a62d970d0bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (540bd2bc-f1cb-4d5d-9b57-1848395a6c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e20a1dcb-eb1a-40e8-8158-e12c97eaa164 tempest-VolumesActionsTest-1176695170 None] Created volume successfully. Jul 10 06:47:03 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536 1073741824" returned: 0 in 1.051s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:03 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536 Jul 10 06:47:03 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Acquiring lock "cinder-9e3715c9-5f10-49aa-8db8-00ea1e970f1e-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Lock "cinder-9e3715c9-5f10-49aa-8db8-00ea1e970f1e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Acquiring lock "cinder-quobyte-9e3715c9-5f10-49aa-8db8-00ea1e970f1e" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Lock "cinder-quobyte-9e3715c9-5f10-49aa-8db8-00ea1e970f1e" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[43231452-db45-4822-b09a-f18686c31197]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1aebee77-6fcd-4325-804f-3f7845ef1976 tempest-GroupSnapshotsV319Test-1093940399 None] Group tempest-GroupSnapshotsV319Test-Group-1564662404: creating Jul 10 06:47:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1aebee77-6fcd-4325-804f-3f7845ef1976 tempest-GroupSnapshotsV319Test-1093940399 None] Group tempest-GroupSnapshotsV319Test-Group-1564662404: created successfully Jul 10 06:47:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1aebee77-6fcd-4325-804f-3f7845ef1976 tempest-GroupSnapshotsV319Test-1093940399 None] Create group completed successfully. Jul 10 06:47:04 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e Jul 10 06:47:04 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:04 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536" returned: 0 in 0.782s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088c662c-2b98-4471-af22-99d0ba3fa163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef05296-485f-40aa-ba2c-cb237f1be536', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36676cde-49e3-4963-a3cd-6c940b24fb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Volume volume-7ef05296-485f-40aa-ba2c-cb237f1be536 (7ef05296-485f-40aa-ba2c-cb237f1be536): created successfully Jul 10 06:47:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36676cde-49e3-4963-a3cd-6c940b24fb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Flow 'volume_create_manager' (d34bde76-9f9f-4d90-9c38-0ad2c894c155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ca065899-70db-4900-88fe-4946710f66e2 tempest-AttachVolumeTestJSON-1394904718 None] Created volume successfully. Jul 10 06:47:05 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e" returned: 0 in 0.865s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:05 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e Jul 10 06:47:05 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:05 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9e3715c9-5f10-49aa-8db8-00ea1e970f1e" returned: 0 in 0.811s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Lock "cinder-quobyte-9e3715c9-5f10-49aa-8db8-00ea1e970f1e" released by "delete_volume" :: held 1.775s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:05 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Created reservations ['5bf46047-37d6-4f72-af0c-7a6fc7e38cb6', '8b9684fd-f37a-4991-927a-a8454dc3c0b8', '1b128fd1-2409-4950-a33b-985e462af8f7', 'c9f2e361-03e0-4856-a428-eba5c6a32b6a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:06 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:47:06 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Flow 'volume_create_manager' (57d1c1bd-e5db-4428-b583-334c540fd046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c8a3bb-0141-44c3-b3b1-6e28decd7e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c8a3bb-0141-44c3-b3b1-6e28decd7e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1607301285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81ca4e0a-047d-4fee-9e32-5960c71e0899,host='devstack@QuobyteHD#QuobyteHD',id=37901826-ca61-490b-a2f7-cb18c236b8e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e37ddb5b63d4d4a857747e984b5a190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:06Z,use_quota=True,user_id='73a3f1ea22fb48c18cf404fc8b0ee360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8528fbde-3783-4ffd-90e4-382454ff8050),volume_type_id=8528fbde-3783-4ffd-90e4-382454ff8050)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba7babc-5540-46fd-9a5d-4342eff33e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba7babc-5540-46fd-9a5d-4342eff33e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10fdefa-a27e-49aa-a125-ef30f2c0df6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10fdefa-a27e-49aa-a125-ef30f2c0df6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37901826-ca61-490b-a2f7-cb18c236b8e8', 'volume_name': 'volume-37901826-ca61-490b-a2f7-cb18c236b8e8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12662537-e180-4faa-9d0a-22a784d26db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12662537-e180-4faa-9d0a-22a784d26db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcfb60c-489c-44ca-a606-96ed2993757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Volume 37901826-ca61-490b-a2f7-cb18c236b8e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37901826-ca61-490b-a2f7-cb18c236b8e8', 'volume_size': 1} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=81ca4e0a-047d-4fee-9e32-5960c71e0899,created_at=2026-07-10T04:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1607301285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=81ca4e0a-047d-4fee-9e32-5960c71e0899,host='devstack@QuobyteHD#QuobyteHD',id=37901826-ca61-490b-a2f7-cb18c236b8e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e37ddb5b63d4d4a857747e984b5a190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:06Z,use_quota=True,user_id='73a3f1ea22fb48c18cf404fc8b0ee360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8528fbde-3783-4ffd-90e4-382454ff8050),volume_type_id=8528fbde-3783-4ffd-90e4-382454ff8050)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Creating volume 37901826-ca61-490b-a2f7-cb18c236b8e8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:06 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:06 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 1073741824 Jul 10 06:47:06 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:06 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (1c702e29-5811-4fb6-a764-7baa0535b559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ac7fb6-966d-4835-a52d-954cf1d191bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.907s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:06 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ac7fb6-966d-4835-a52d-954cf1d191bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-312504712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f58671-cff9-42ad-9734-685cc4ffae55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:07Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc1f096-984b-44fb-8eb3-637a8003ecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc1f096-984b-44fb-8eb3-637a8003ecd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e063d1d4-631f-423e-94ec-e13305cf3ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e063d1d4-631f-423e-94ec-e13305cf3ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f58671-cff9-42ad-9734-685cc4ffae55', 'volume_name': 'volume-02f58671-cff9-42ad-9734-685cc4ffae55', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61ef96d-0bb1-4b5f-84a3-eedfed479261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d61ef96d-0bb1-4b5f-84a3-eedfed479261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59406ea-9758-4fa5-85b2-0d2c0eaa1925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Volume 02f58671-cff9-42ad-9734-685cc4ffae55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f58671-cff9-42ad-9734-685cc4ffae55', 'volume_size': 1} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Deleted volume successfully. Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-65c728fd-dce8-4cc1-9f41-7eb20549a56d tempest-VolumesActionsTest-680560106 None] Lock "cinder-9e3715c9-5f10-49aa-8db8-00ea1e970f1e-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:07 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 1073741824" returned: 0 in 1.151s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:07 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 Jul 10 06:47:07 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Flow 'volume_create_manager' (fd8bcff1-0dcd-4cb3-9434-f15085d98507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47e9aa8-c12b-42f7-a85f-c1d375d32700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47e9aa8-c12b-42f7-a85f-c1d375d32700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc03dcf-d467-4b48-9800-2960b9f43849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f8667860cf4983b16707a2759a4626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:08Z,use_quota=True,user_id='85e2b20862f2423f948e7c0ab04cf864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2053cb6d-070b-4d5e-9132-54d0f49b3c42),volume_type_id=2053cb6d-070b-4d5e-9132-54d0f49b3c42)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cacb76b-4d05-4824-95ec-602388190b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cacb76b-4d05-4824-95ec-602388190b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b44fac-e981-417a-9c4a-96e6018cd3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:07 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b44fac-e981-417a-9c4a-96e6018cd3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2dc03dcf-d467-4b48-9800-2960b9f43849', 'volume_name': 'volume-2dc03dcf-d467-4b48-9800-2960b9f43849', 'volume_size': 1, 'image_id': 'f9922378-00fe-4812-a095-e8e7b5c229d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9922378-00fe-4812-a095-e8e7b5c229d9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '41667c12646887fd45d7f648232ce22d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03f8667860cf4983b16707a2759a4626', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3366e4774be71760e8f0e442f8c24ad5e6a44cbfb340eb890cd45f39cbca8813a40d8378bb5b59e76f1fb6a891d13287661af56b36915dfed01ae95855a04f60', 'id': 'f9922378-00fe-4812-a095-e8e7b5c229d9', 'created_at': datetime.datetime(2026, 7, 10, 4, 47, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 47, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9922378-00fe-4812-a095-e8e7b5c229d9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f9e7df-7258-4030-a057-6c5dae23baa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f9e7df-7258-4030-a057-6c5dae23baa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da367b10-c456-4ab8-ae68-31029718b2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:08 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Volume 2dc03dcf-d467-4b48-9800-2960b9f43849: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2dc03dcf-d467-4b48-9800-2960b9f43849', 'volume_size': 1, 'image_id': 'f9922378-00fe-4812-a095-e8e7b5c229d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9922378-00fe-4812-a095-e8e7b5c229d9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '41667c12646887fd45d7f648232ce22d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03f8667860cf4983b16707a2759a4626', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3366e4774be71760e8f0e442f8c24ad5e6a44cbfb340eb890cd45f39cbca8813a40d8378bb5b59e76f1fb6a891d13287661af56b36915dfed01ae95855a04f60', 'id': 'f9922378-00fe-4812-a095-e8e7b5c229d9', 'created_at': datetime.datetime(2026, 7, 10, 4, 47, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 47, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9922378-00fe-4812-a095-e8e7b5c229d9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Trying to clone 2dc03dcf-d467-4b48-9800-2960b9f43849 from image f9922378-00fe-4812-a095-e8e7b5c229d9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f9922378-00fe-4812-a095-e8e7b5c229d9', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:47:08 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8" returned: 0 in 0.806s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.246s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-312504712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f58671-cff9-42ad-9734-685cc4ffae55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a3aa79eb284e63b4428f5c816744e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:07Z,use_quota=True,user_id='f07e8012ce3d48a3ad815905ab881672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Creating volume 02f58671-cff9-42ad-9734-685cc4ffae55 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:08 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:08 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55 1073741824 Jul 10 06:47:08 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcfb60c-489c-44ca-a606-96ed2993757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37901826-ca61-490b-a2f7-cb18c236b8e8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497b94a5-7289-47e7-b1d7-33f8c6a2e28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:47:08 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Image download 0.00 MB at 0.00 MB/s Jul 10 06:47:08 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Volume volume-37901826-ca61-490b-a2f7-cb18c236b8e8 (37901826-ca61-490b-a2f7-cb18c236b8e8): created successfully Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497b94a5-7289-47e7-b1d7-33f8c6a2e28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Flow 'volume_create_manager' (57d1c1bd-e5db-4428-b583-334c540fd046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c5f8b7ee-3cce-49b0-b245-535e24c84e63 tempest-GroupSnapshotsV319Test-1093940399 None] Created volume successfully. Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad01a20c-351e-48e4-bdb8-5c3693ea72a2]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:08 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD Jul 10 06:47:08 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] GroupSnapshot 875c9ed9-4580-4a0a-9123-6385687c60da: creating. Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] Group snapshot 875c9ed9-4580-4a0a-9123-6385687c60da: creating. {{(pid=86966) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 06:47:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-00dd3c17-d193-45f0-a996-58d77ca73404 req-ec23d197-ddd5-473f-822a-e96e2ff6f13b tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:09 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55 1073741824" returned: 0 in 0.930s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:09 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55 Jul 10 06:47:09 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:09 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD" returned: 0 in 0.886s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:09 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD Jul 10 06:47:09 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:09 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55" returned: 0 in 0.693s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.093s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:09 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59406ea-9758-4fa5-85b2-0d2c0eaa1925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f58671-cff9-42ad-9734-685cc4ffae55', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1529238-5db8-47e6-a8b1-913fb717e27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] Creating offline snapshot e444a6bb-90e3-4ed0-87ae-6e51be4468fd of volume 37901826-ca61-490b-a2f7-cb18c236b8e8 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:47:10 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Volume volume-02f58671-cff9-42ad-9734-685cc4ffae55 (02f58671-cff9-42ad-9734-685cc4ffae55): created successfully Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1529238-5db8-47e6-a8b1-913fb717e27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Flow 'volume_create_manager' (1c702e29-5811-4fb6-a764-7baa0535b559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf180b8f-4a32-42ce-9877-ed41368960c7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c5296d0c-487a-44bc-8878-e2c9a084c2dc tempest-VolumesActionsTest-1176695170 None] Created volume successfully. Jul 10 06:47:10 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD" returned: 1 in 0.806s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Temporary image f9922378-00fe-4812-a095-e8e7b5c229d9 is fetched for user 85e2b20862f2423f948e7c0ab04cf864. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:47:10 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 Jul 10 06:47:10 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ad1706-6864-416b-a753-75352ba815cb]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:10 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD Jul 10 06:47:10 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:10 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:10 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd 1G Jul 10 06:47:10 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:10 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:11 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD Jul 10 06:47:11 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:11 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:47:11 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:11 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD" returned: 1 in 0.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:11 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd 1G" returned: 0 in 0.964s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37901826-ca61-490b-a2f7-cb18c236b8e8 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:11 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37901826-ca61-490b-a2f7-cb18c236b8e8 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd Jul 10 06:47:11 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "cinder-02f58671-cff9-42ad-9734-685cc4ffae55-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Lock "cinder-02f58671-cff9-42ad-9734-685cc4ffae55-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "cinder-quobyte-02f58671-cff9-42ad-9734-685cc4ffae55" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Lock "cinder-quobyte-02f58671-cff9-42ad-9734-685cc4ffae55" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[94947fc5-8496-42bd-9168-d2d314b831c8]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:12 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55 Jul 10 06:47:12 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:12 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.796s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:47:12 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37901826-ca61-490b-a2f7-cb18c236b8e8 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:12 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:12 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd Jul 10 06:47:12 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:12 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55" returned: 0 in 0.845s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:12 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55 Jul 10 06:47:12 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:13 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd" returned: 0 in 0.669s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:13 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.info Jul 10 06:47:13 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:13 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-02f58671-cff9-42ad-9734-685cc4ffae55" returned: 0 in 0.711s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Lock "cinder-quobyte-02f58671-cff9-42ad-9734-685cc4ffae55" released by "delete_volume" :: held 1.620s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Created reservations ['7bcddc2f-d69d-4407-83f8-df3a7c924133', '5bc110d5-9f0c-476d-9ade-5f8632407ff2', '9a7e4dac-7539-4cc0-8a32-b8f030f0a346', '0c136261-2e30-4906-a7e5-095e0d6cd20b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:13 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:47:13 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:13 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.info" returned: 0 in 0.681s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:13 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:47:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:13 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.info Jul 10 06:47:13 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:14 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.708s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:14 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Deleted volume successfully. Jul 10 06:47:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9a00535a-8658-4807-ab87-42c97dc984b8 tempest-VolumesActionsTest-1176695170 None] Lock "cinder-02f58671-cff9-42ad-9734-685cc4ffae55-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:14 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.info" returned: 0 in 0.694s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.702s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-00dd3c17-d193-45f0-a996-58d77ca73404 req-ec23d197-ddd5-473f-822a-e96e2ff6f13b tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.631s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[33533dc0-826e-4a68-ae5f-28713ff31d97]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-00dd3c17-d193-45f0-a996-58d77ca73404 req-ec23d197-ddd5-473f-822a-e96e2ff6f13b tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4ab50fe1-5be6-41a3-90b3-dd6ee28affde tempest-GroupSnapshotsV319Test-1093940399 None] group_snapshot 875c9ed9-4580-4a0a-9123-6385687c60da: created successfully Jul 10 06:47:14 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536 Jul 10 06:47:14 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:15 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-00dd3c17-d193-45f0-a996-58d77ca73404 req-ec23d197-ddd5-473f-822a-e96e2ff6f13b tempest-AttachVolumeTestJSON-1394904718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536" returned: 0 in 0.873s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-00dd3c17-d193-45f0-a996-58d77ca73404 req-ec23d197-ddd5-473f-822a-e96e2ff6f13b tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.898s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.816s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc03dcf-d467-4b48-9800-2960b9f43849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f8667860cf4983b16707a2759a4626',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:08Z,use_quota=True,user_id='85e2b20862f2423f948e7c0ab04cf864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2053cb6d-070b-4d5e-9132-54d0f49b3c42),volume_type_id=2053cb6d-070b-4d5e-9132-54d0f49b3c42)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Creating volume 2dc03dcf-d467-4b48-9800-2960b9f43849 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:15 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] group_snapshot 875c9ed9-4580-4a0a-9123-6385687c60da: deleting Jul 10 06:47:15 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 1073741824 Jul 10 06:47:15 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] group_snapshot 875c9ed9-4580-4a0a-9123-6385687c60da: deleting {{(pid=86966) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-00dd3c17-d193-45f0-a996-58d77ca73404 req-ec23d197-ddd5-473f-822a-e96e2ff6f13b tempest-AttachVolumeTestJSON-1394904718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-7ef05296-485f-40aa-ba2c-cb237f1be536', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa4a3175-1945-4c0f-9838-e4f93bbcf2a1', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Acquiring lock "cinder-quobyte-37901826-ca61-490b-a2f7-cb18c236b8e8" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Lock "cinder-quobyte-37901826-ca61-490b-a2f7-cb18c236b8e8" acquired by "delete_snapshot" :: waited 0.071s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Acquiring lock "cinder-quobyte-e444a6bb-90e3-4ed0-87ae-6e51be4468fd" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Lock "cinder-quobyte-e444a6bb-90e3-4ed0-87ae-6e51be4468fd" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Deleting offline snapshot e444a6bb-90e3-4ed0-87ae-6e51be4468fd of volume 37901826-ca61-490b-a2f7-cb18c236b8e8 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] snapshot_file for this snap is: volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:47:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-00dd3c17-d193-45f0-a996-58d77ca73404 req-ec23d197-ddd5-473f-822a-e96e2ff6f13b tempest-AttachVolumeTestJSON-1394904718 None] attachment_update completed successfully. Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0959c4-1c64-4c35-914f-557ec586c2f2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:16 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd Jul 10 06:47:16 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:16 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 1073741824" returned: 0 in 0.990s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:16 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 Jul 10 06:47:16 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:16 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd" returned: 0 in 0.972s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37901826-ca61-490b-a2f7-cb18c236b8e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:47:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb87fab-69f4-4398-b719-d92d18aa3834]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:17 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 Jul 10 06:47:17 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:17 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849" returned: 0 in 0.965s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:17 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Attempting download of f9922378-00fe-4812-a095-e8e7b5c229d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9922378-00fe-4812-a095-e8e7b5c229d9', 'metadata': {}}])) to volume 2dc03dcf-d467-4b48-9800-2960b9f43849. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:47:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f5a261-c0ba-44a6-9de6-66a94b6f98fa]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9922378-00fe-4812-a095-e8e7b5c229d9_doea0hjf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:17 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9922378-00fe-4812-a095-e8e7b5c229d9_doea0hjf Jul 10 06:47:17 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:17 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8" returned: 0 in 1.033s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:18 devstack sudo[94762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd Jul 10 06:47:18 devstack sudo[94762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:18 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9922378-00fe-4812-a095-e8e7b5c229d9_doea0hjf" returned: 0 in 0.883s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9922378-00fe-4812-a095-e8e7b5c229d9_doea0hjf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:18 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9922378-00fe-4812-a095-e8e7b5c229d9_doea0hjf Jul 10 06:47:18 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:18 devstack sudo[94762]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd" returned: 0 in 0.919s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:18 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd Jul 10 06:47:18 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:19 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9922378-00fe-4812-a095-e8e7b5c229d9_doea0hjf" returned: 1 in 0.839s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9922378-00fe-4812-a095-e8e7b5c229d9_doea0hjf' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:47:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[75295845-f09a-4e77-9d30-130b97d43d25]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:19 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD Jul 10 06:47:19 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:19 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8.e444a6bb-90e3-4ed0-87ae-6e51be4468fd" returned: 0 in 0.744s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Lock "cinder-quobyte-e444a6bb-90e3-4ed0-87ae-6e51be4468fd" released by "_delete_snapshot" :: held 3.842s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Lock "cinder-quobyte-37901826-ca61-490b-a2f7-cb18c236b8e8" released by "delete_snapshot" :: held 3.885s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:19 devstack cinder-volume[86966]: WARNING cinder.quota [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1629657868 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1629657868, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:47:19 devstack cinder-volume[86966]: WARNING cinder.quota [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1629657868 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1629657868, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:47:19 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] Created reservations ['088d16b2-68b5-4d49-b7fc-2dc76f102e56', '9be65ab5-fdd2-4f93-bb2e-1a6b68026f82', 'a6c7bbf7-8b26-412a-acfb-f759faf617d1', 'd318dd12-72c4-4996-95f1-f1592f355bfb'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5d2e91f0-577e-405f-846a-770ff6c808d5 tempest-GroupSnapshotsV319Test-1093940399 None] group_snapshot 875c9ed9-4580-4a0a-9123-6385687c60da: deleted successfully Jul 10 06:47:20 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Acquiring lock "cinder-quobyte-37901826-ca61-490b-a2f7-cb18c236b8e8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Lock "cinder-quobyte-37901826-ca61-490b-a2f7-cb18c236b8e8" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:20 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD Jul 10 06:47:20 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa79520-0d4b-4240-abcf-118c4a525bd7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:20 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 Jul 10 06:47:20 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:21 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD" returned: 1 in 1.077s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:47:21 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] f9922378-00fe-4812-a095-e8e7b5c229d9 was raw, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:47:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:21 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 Jul 10 06:47:21 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:21 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8" returned: 0 in 0.944s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:21 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8 Jul 10 06:47:21 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:22 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:22 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849" returned: 0 in 0.994s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f9922378-00fe-4812-a095-e8e7b5c229d9_0ksrubavdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:47:22 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-37901826-ca61-490b-a2f7-cb18c236b8e8" returned: 0 in 0.876s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Lock "cinder-quobyte-37901826-ca61-490b-a2f7-cb18c236b8e8" released by "delete_volume" :: held 1.937s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:22 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 1G Jul 10 06:47:22 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Created reservations ['04374ab4-c20d-4169-88ad-5dbcf38cb1c4'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:22 devstack cinder-volume[86966]: WARNING cinder.quota [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1629657868 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1629657868, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Created reservations ['be21caa9-f4b3-4bb5-8e8d-98f58def9fdd', 'e7a5ae4f-3d04-497d-9f5c-670163f441f1', '75184010-dade-4e79-8e2e-dd41526b3829', '27b1d519-e49f-4ddc-80f3-c5700e5769ed'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:22 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:47:22 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:23 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 1G" returned: 0 in 0.972s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a75c7b8-9d9d-4bfe-be9b-4bec046e6117]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:23 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 Jul 10 06:47:23 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:23 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.969s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:23 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8235dd8e-abc7-43b2-be2d-75d44886608a tempest-GroupSnapshotsV319Test-1093940399 None] Delete group completed successfully. Jul 10 06:47:24 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849" returned: 0 in 1.127s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:24 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 Jul 10 06:47:24 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:25 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849" returned: 1 in 0.886s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Downloaded image f9922378-00fe-4812-a095-e8e7b5c229d9 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9922378-00fe-4812-a095-e8e7b5c229d9', 'metadata': {}}])) to volume 2dc03dcf-d467-4b48-9800-2960b9f43849 successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:47:25 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Temporary image f9922378-00fe-4812-a095-e8e7b5c229d9 for user 85e2b20862f2423f948e7c0ab04cf864 is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Marking volume 2dc03dcf-d467-4b48-9800-2960b9f43849 as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Copying metadata from image f9922378-00fe-4812-a095-e8e7b5c229d9 to 2dc03dcf-d467-4b48-9800-2960b9f43849. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Creating volume glance metadata for volume 2dc03dcf-d467-4b48-9800-2960b9f43849 backed by image f9922378-00fe-4812-a095-e8e7b5c229d9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f9922378-00fe-4812-a095-e8e7b5c229d9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '41667c12646887fd45d7f648232ce22d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da367b10-c456-4ab8-ae68-31029718b2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc03dcf-d467-4b48-9800-2960b9f43849', 'volume_size': 1, 'image_id': 'f9922378-00fe-4812-a095-e8e7b5c229d9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9922378-00fe-4812-a095-e8e7b5c229d9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '41667c12646887fd45d7f648232ce22d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03f8667860cf4983b16707a2759a4626', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3366e4774be71760e8f0e442f8c24ad5e6a44cbfb340eb890cd45f39cbca8813a40d8378bb5b59e76f1fb6a891d13287661af56b36915dfed01ae95855a04f60', 'id': 'f9922378-00fe-4812-a095-e8e7b5c229d9', 'created_at': datetime.datetime(2026, 7, 10, 4, 47, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 47, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9922378-00fe-4812-a095-e8e7b5c229d9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dade2cd-be53-4d27-a4ed-2b50688a036b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Volume volume-2dc03dcf-d467-4b48-9800-2960b9f43849 (2dc03dcf-d467-4b48-9800-2960b9f43849): created successfully Jul 10 06:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dade2cd-be53-4d27-a4ed-2b50688a036b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Flow 'volume_create_manager' (fd8bcff1-0dcd-4cb3-9434-f15085d98507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-06ae8420-4658-405d-bffd-3adc9f1f0cc4 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Created volume successfully. Jul 10 06:47:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Acquiring lock "cinder-2dc03dcf-d467-4b48-9800-2960b9f43849-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Lock "cinder-2dc03dcf-d467-4b48-9800-2960b9f43849-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Acquiring lock "cinder-quobyte-2dc03dcf-d467-4b48-9800-2960b9f43849" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Lock "cinder-quobyte-2dc03dcf-d467-4b48-9800-2960b9f43849" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b91b2d7-ba2c-41f9-af5a-c7da5045c094]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:26 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 Jul 10 06:47:26 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:27 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849" returned: 0 in 0.970s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:27 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 Jul 10 06:47:27 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:28 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849" returned: 1 in 0.951s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:47:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:28 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849 Jul 10 06:47:28 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:29 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2dc03dcf-d467-4b48-9800-2960b9f43849" returned: 0 in 0.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Lock "cinder-quobyte-2dc03dcf-d467-4b48-9800-2960b9f43849" released by "delete_volume" :: held 2.780s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:29 devstack cinder-volume[86966]: WARNING cinder.quota [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:47:29 devstack cinder-volume[86966]: WARNING cinder.quota [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:47:29 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Created reservations ['76200ef1-27a2-41f4-bc41-5868de2a00cf', '87c62609-4631-4305-8ebc-66351e79a549', '88b1f1f8-0b7b-4582-a6c5-951f0da9b94d', '444218ad-9c5b-44bb-a3fc-4ef6c639b0a1'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:29 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:47:29 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:30 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.155s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:30 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Deleted volume successfully. Jul 10 06:47:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-edef345d-6d7c-4ac8-b911-dbf6f76bed70 tempest-VolumeAndVolumeTypeFromImageTest-1529799030 None] Lock "cinder-2dc03dcf-d467-4b48-9800-2960b9f43849-delete_volume" released by "delete_volume" :: held 4.285s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Flow 'volume_create_manager' (b66a048e-94b0-477d-a3ed-503dc40443fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ceaba4-564b-4a03-a5c6-1f0382ce8cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ceaba4-564b-4a03-a5c6-1f0382ce8cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-411201815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e4ff80-7ba5-436c-a264-4d52cc7d5df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a809be057fb473dad914166f7996d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:31Z,use_quota=True,user_id='09ac1ad65fe34d61a7c68a2e2959a17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ee2e1a-88dd-493d-a0b1-813dffe206aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ee2e1a-88dd-493d-a0b1-813dffe206aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d32fcd-77d8-44b7-af7d-e86492d16fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d32fcd-77d8-44b7-af7d-e86492d16fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e4ff80-7ba5-436c-a264-4d52cc7d5df4', 'volume_name': 'volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4', 'volume_size': 2}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae69461-e115-4a82-a1ae-91c3907b4573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae69461-e115-4a82-a1ae-91c3907b4573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425404cb-a5f2-49bf-9004-5b8240adfaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:31 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Volume 05e4ff80-7ba5-436c-a264-4d52cc7d5df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4', 'volume_size': 2} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-411201815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e4ff80-7ba5-436c-a264-4d52cc7d5df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a809be057fb473dad914166f7996d1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:31Z,use_quota=True,user_id='09ac1ad65fe34d61a7c68a2e2959a17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Creating volume 05e4ff80-7ba5-436c-a264-4d52cc7d5df4 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:31 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4 2147483648 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:31 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4 2147483648 Jul 10 06:47:31 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:32 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4 2147483648" returned: 0 in 1.218s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:32 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4 Jul 10 06:47:32 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:33 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4" returned: 0 in 0.902s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425404cb-a5f2-49bf-9004-5b8240adfaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4', 'volume_size': 2}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42de2dd7-a5f8-4c0f-8c7e-ecf5bd6385de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Volume volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4 (05e4ff80-7ba5-436c-a264-4d52cc7d5df4): created successfully Jul 10 06:47:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42de2dd7-a5f8-4c0f-8c7e-ecf5bd6385de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Flow 'volume_create_manager' (b66a048e-94b0-477d-a3ed-503dc40443fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-74e9b979-becf-4c34-bde7-11eb5a9cc99e tempest-VolumesCloneNegativeTest-282219096 None] Created volume successfully. Jul 10 06:47:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Acquiring lock "cinder-05e4ff80-7ba5-436c-a264-4d52cc7d5df4-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Lock "cinder-05e4ff80-7ba5-436c-a264-4d52cc7d5df4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:34 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=147,cinder:INSERT=58,cinder:UPDATE=152,cinder:DELETE=7 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:47:34 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=128,cinder:INSERT=36,cinder:UPDATE=170,cinder:DELETE=13 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:47:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Acquiring lock "cinder-quobyte-05e4ff80-7ba5-436c-a264-4d52cc7d5df4" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Lock "cinder-quobyte-05e4ff80-7ba5-436c-a264-4d52cc7d5df4" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[568fa569-fbe9-4694-a35d-aefc7afe4ab1]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:35 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4 Jul 10 06:47:35 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:36 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4" returned: 0 in 1.078s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:36 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4 Jul 10 06:47:36 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:37 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05e4ff80-7ba5-436c-a264-4d52cc7d5df4" returned: 0 in 1.155s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Lock "cinder-quobyte-05e4ff80-7ba5-436c-a264-4d52cc7d5df4" released by "delete_volume" :: held 2.314s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:37 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Created reservations ['ba66c28a-4916-4455-a63b-a22c3a17ac8f', 'fa9a990b-6258-45be-9985-22011b73330e', 'b29280d1-5065-4928-aa84-42ff372df630', 'bed6b37a-6dc1-49ce-a7e9-a04f5775fbf4'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:37 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:47:37 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (ed9b359a-bdae-4b74-abb3-c3b9ad87fbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fdd943-fff8-486e-89d1-68e3c6beede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fdd943-fff8-486e-89d1-68e3c6beede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1092978204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e58bdd-03bc-4081-975b-fd33f0aa81d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:38Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245f8bf4-d961-40a9-8493-991868f9bf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245f8bf4-d961-40a9-8493-991868f9bf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d64bdc-16ba-4466-aa5b-b027c94f2a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d64bdc-16ba-4466-aa5b-b027c94f2a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e58bdd-03bc-4081-975b-fd33f0aa81d8', 'volume_name': 'volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62df8142-c8ee-41c8-bfa2-233e6f7d124b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62df8142-c8ee-41c8-bfa2-233e6f7d124b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f57ad10-01ce-47d7-b6cf-b197524aa18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:38 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume e1e58bdd-03bc-4081-975b-fd33f0aa81d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8', 'volume_size': 1} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1092978204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e58bdd-03bc-4081-975b-fd33f0aa81d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:38Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Creating volume e1e58bdd-03bc-4081-975b-fd33f0aa81d8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:38 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:38 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8 1073741824 Jul 10 06:47:38 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:38 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.167s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Deleted volume successfully. Jul 10 06:47:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c023f108-2d18-4d01-b1bd-b11d1796362a tempest-VolumesCloneNegativeTest-282219096 None] Lock "cinder-05e4ff80-7ba5-436c-a264-4d52cc7d5df4-delete_volume" released by "delete_volume" :: held 3.881s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9ff7fee9-08ed-4a21-9763-cb02c1855946 tempest-GroupsTest-1060018464 None] Group tempest-Group1-1161434636: creating Jul 10 06:47:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9ff7fee9-08ed-4a21-9763-cb02c1855946 tempest-GroupsTest-1060018464 None] Group tempest-Group1-1161434636: created successfully Jul 10 06:47:39 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9ff7fee9-08ed-4a21-9763-cb02c1855946 tempest-GroupsTest-1060018464 None] Create group completed successfully. Jul 10 06:47:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8 1073741824" returned: 0 in 1.194s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:39 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8 Jul 10 06:47:39 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:40 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f57ad10-01ce-47d7-b6cf-b197524aa18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474556d5-6c94-4fc7-a09b-1e4721d3152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8 (e1e58bdd-03bc-4081-975b-fd33f0aa81d8): created successfully Jul 10 06:47:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (474556d5-6c94-4fc7-a09b-1e4721d3152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (ed9b359a-bdae-4b74-abb3-c3b9ad87fbe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-500b1f24-84d8-4099-bc94-de05d80591e5 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created volume successfully. Jul 10 06:47:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-aab768a1-f92e-43b7-9d7a-d80caf2c18ec tempest-GroupsTest-1060018464 None] Group tempest-Group2-1401111340: creating Jul 10 06:47:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-aab768a1-f92e-43b7-9d7a-d80caf2c18ec tempest-GroupsTest-1060018464 None] Group tempest-Group2-1401111340: created successfully Jul 10 06:47:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-aab768a1-f92e-43b7-9d7a-d80caf2c18ec tempest-GroupsTest-1060018464 None] Create group completed successfully. Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (dcdcb672-718b-4f8f-af1e-c28e80748c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5d70dd-4e4c-425c-88b9-6968b8d6dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5d70dd-4e4c-425c-88b9-6968b8d6dc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-423439054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d3ab19-8991-4247-8fd9-99156b9fc79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:42Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b514ff18-4d20-4356-87cc-e19b433d4360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b514ff18-4d20-4356-87cc-e19b433d4360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff00bdcd-acd5-482b-b91d-cb96a22ba1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff00bdcd-acd5-482b-b91d-cb96a22ba1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d3ab19-8991-4247-8fd9-99156b9fc79c', 'volume_name': 'volume-64d3ab19-8991-4247-8fd9-99156b9fc79c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b2895d-66f0-4b8c-9186-ce7adcfa0606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b2895d-66f0-4b8c-9186-ce7adcfa0606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed8c9d1-bda8-486a-9536-d9625d5c2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume 64d3ab19-8991-4247-8fd9-99156b9fc79c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d3ab19-8991-4247-8fd9-99156b9fc79c', 'volume_size': 1} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-423439054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d3ab19-8991-4247-8fd9-99156b9fc79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:42Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Creating volume 64d3ab19-8991-4247-8fd9-99156b9fc79c {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:42 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (750c7454-db85-4a52-b2b9-22574986d980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:42 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c 1073741824 Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7ae479-c68c-4de3-bbc9-cd999bcdd6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:42 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd7ae479-c68c-4de3-bbc9-cd999bcdd6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1094451417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb10e35-7e43-42c2-8e9d-326539c9617c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:42Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be07cca-976e-406c-8579-d70a3ec8efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be07cca-976e-406c-8579-d70a3ec8efc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ac8e68-f0f0-4377-ade1-2db0adaabea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ac8e68-f0f0-4377-ade1-2db0adaabea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddb10e35-7e43-42c2-8e9d-326539c9617c', 'volume_name': 'volume-ddb10e35-7e43-42c2-8e9d-326539c9617c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16799c6-dcbc-4d7b-a8d7-a73beb585a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16799c6-dcbc-4d7b-a8d7-a73beb585a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed1ca48-0a4d-4517-a2b9-01d5cf44c09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Volume ddb10e35-7e43-42c2-8e9d-326539c9617c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddb10e35-7e43-42c2-8e9d-326539c9617c', 'volume_size': 1} Jul 10 06:47:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (9bd79bf8-5aab-4166-a1ac-f2dcce716532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611d768f-d57f-44c0-9efb-cb283152f6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611d768f-d57f-44c0-9efb-cb283152f6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260848076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:43Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (867d5b29-59b1-4e96-bee9-a329f74300ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (867d5b29-59b1-4e96-bee9-a329f74300ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1230c18-b69d-4267-a082-f6b1cb239517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1230c18-b69d-4267-a082-f6b1cb239517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4', 'volume_name': 'volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6a7e88-5112-464c-acba-b82ba1b2260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6a7e88-5112-464c-acba-b82ba1b2260d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643dcd84-de80-4363-b654-37f6223de2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4', 'volume_size': 1} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:43 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c 1073741824" returned: 0 in 1.225s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:44 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:44 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Flow 'volume_create_manager' (a538748a-3bd5-47a9-aa62-d16e66c0bd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e411dc61-94e4-489b-857f-e32850560135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e411dc61-94e4-489b-857f-e32850560135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1233881411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48a5e227-8de6-4e46-aaa3-12774ee9cccc,host='devstack@QuobyteHD#QuobyteHD',id=6df74c7f-30fe-4b94-b7f2-fcdc26e53690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3419d19c993646b58fa2001ce9689323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:44Z,use_quota=True,user_id='2044f5e8c9e845cd909805ca97ff524c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6ecb21c-8b10-4a06-88fe-96ccbef7c614),volume_type_id=f6ecb21c-8b10-4a06-88fe-96ccbef7c614)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36975bfa-29b1-44af-9c6e-e146e62186c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36975bfa-29b1-44af-9c6e-e146e62186c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679a0e78-e8f8-4975-af22-9e3d509ef7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679a0e78-e8f8-4975-af22-9e3d509ef7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df74c7f-30fe-4b94-b7f2-fcdc26e53690', 'volume_name': 'volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f2a30b-8067-424b-8722-61f6e6df1cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f2a30b-8067-424b-8722-61f6e6df1cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0669d0f4-1879-4fd7-baed-6ebe3af01261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Volume 6df74c7f-30fe-4b94-b7f2-fcdc26e53690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690', 'volume_size': 1} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (ab577a84-ec56-4c19-9360-215adaf4b286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1909bdb8-469a-453a-9fd5-d778a01b3665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1909bdb8-469a-453a-9fd5-d778a01b3665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259005154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9293c049-fd5d-40e2-a4e2-7e7300938826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:44Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571ea99e-ed3f-4980-a0c1-840c9b092c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571ea99e-ed3f-4980-a0c1-840c9b092c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b240a1-3e9f-4438-a445-47ead6b3b2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b240a1-3e9f-4438-a445-47ead6b3b2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9293c049-fd5d-40e2-a4e2-7e7300938826', 'volume_name': 'volume-9293c049-fd5d-40e2-a4e2-7e7300938826', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4d2c44-9045-4455-aa1a-11e1027c9b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4d2c44-9045-4455-aa1a-11e1027c9b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6e4942-e718-48dd-a964-6dc8e626a1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume 9293c049-fd5d-40e2-a4e2-7e7300938826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9293c049-fd5d-40e2-a4e2-7e7300938826', 'volume_size': 1} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (38cf23d3-d945-452b-b094-97228bef6091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5d673b-1be3-4524-8ee1-25493b111cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5d673b-1be3-4524-8ee1-25493b111cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1382756622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b78e4c4-83f4-43b7-81d5-5db3607f8476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:44Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d992e7-d936-4e50-bbe4-a6ff2eac62de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d992e7-d936-4e50-bbe4-a6ff2eac62de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce0fde9-8d49-4295-88f5-75b897a65198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bce0fde9-8d49-4295-88f5-75b897a65198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b78e4c4-83f4-43b7-81d5-5db3607f8476', 'volume_name': 'volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee6a0bd-e697-4f14-a78b-202e084980d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee6a0bd-e697-4f14-a78b-202e084980d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd79c5a3-60a8-4300-a10c-463b795e36c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume 3b78e4c4-83f4-43b7-81d5-5db3607f8476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476', 'volume_size': 1} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (48bca3a5-2e0c-4f51-b8e5-271b488ca6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971f7133-b11d-4795-a178-c914a6acbffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971f7133-b11d-4795-a178-c914a6acbffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2138759950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:45Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c66754-b3ab-427e-8b35-2f3e0e944053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c66754-b3ab-427e-8b35-2f3e0e944053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a66519-0a84-4e11-9866-9741fbe2364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a66519-0a84-4e11-9866-9741fbe2364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b', 'volume_name': 'volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beda9842-985b-4c5c-9e31-419568f1f834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beda9842-985b-4c5c-9e31-419568f1f834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd99bee-ae4a-40ac-a1a4-a42ee7861c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume 847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b', 'volume_size': 1} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:44 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c" returned: 0 in 0.911s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.282s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1094451417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddb10e35-7e43-42c2-8e9d-326539c9617c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:42Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Creating volume ddb10e35-7e43-42c2-8e9d-326539c9617c {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:44 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed8c9d1-bda8-486a-9536-d9625d5c2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d3ab19-8991-4247-8fd9-99156b9fc79c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c 1073741824 Jul 10 06:47:44 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2aad3d-216a-40ed-84b8-ef00f83af122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume volume-64d3ab19-8991-4247-8fd9-99156b9fc79c (64d3ab19-8991-4247-8fd9-99156b9fc79c): created successfully Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2aad3d-216a-40ed-84b8-ef00f83af122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (dcdcb672-718b-4f8f-af1e-c28e80748c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-420858c3-849f-4920-8ad9-92c17c1acda1 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created volume successfully. Jul 10 06:47:45 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c 1073741824" returned: 0 in 0.893s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:45 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c Jul 10 06:47:45 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:46 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c" returned: 0 in 0.701s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.951s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260848076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:43Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Creating volume df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:46 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:46 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4 1073741824 Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed1ca48-0a4d-4517-a2b9-01d5cf44c09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddb10e35-7e43-42c2-8e9d-326539c9617c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:46 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b62040-8135-4898-96e4-6457ed4a5d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Volume volume-ddb10e35-7e43-42c2-8e9d-326539c9617c (ddb10e35-7e43-42c2-8e9d-326539c9617c): created successfully Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b62040-8135-4898-96e4-6457ed4a5d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (750c7454-db85-4a52-b2b9-22574986d980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c48b3927-0a4b-48d9-a5dc-9716f8862bd1 tempest-VolumesGetTest-671559070 None] Created volume successfully. Jul 10 06:47:47 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4 1073741824" returned: 0 in 0.934s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:47 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4 Jul 10 06:47:47 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:48 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4" returned: 0 in 0.793s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.144s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=48a5e227-8de6-4e46-aaa3-12774ee9cccc,created_at=2026-07-10T04:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1233881411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48a5e227-8de6-4e46-aaa3-12774ee9cccc,host='devstack@QuobyteHD#QuobyteHD',id=6df74c7f-30fe-4b94-b7f2-fcdc26e53690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3419d19c993646b58fa2001ce9689323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:44Z,use_quota=True,user_id='2044f5e8c9e845cd909805ca97ff524c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6ecb21c-8b10-4a06-88fe-96ccbef7c614),volume_type_id=f6ecb21c-8b10-4a06-88fe-96ccbef7c614)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Creating volume 6df74c7f-30fe-4b94-b7f2-fcdc26e53690 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:48 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643dcd84-de80-4363-b654-37f6223de2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d911ca-8e6f-4952-a4e7-2b0cadaf0a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:48 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690 1073741824 Jul 10 06:47:48 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4 (df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4): created successfully Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d911ca-8e6f-4952-a4e7-2b0cadaf0a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (9bd79bf8-5aab-4166-a1ac-f2dcce716532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a945546f-9170-44d7-a84d-00714c6f50fe tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created volume successfully. Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (1ec3cd43-51e9-4d4e-a9f4-b925d3cad32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f25b089-2d82-4b5e-930e-f7b84b7b4177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f25b089-2d82-4b5e-930e-f7b84b7b4177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1357168593',display_name='tempest-VolumesGetTest-Volume-8429339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d73366-017f-4b00-a434-c33809ec3f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:48Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f831db-6e23-4bbd-b5e1-e6241d22f142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f831db-6e23-4bbd-b5e1-e6241d22f142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87d3236-3dc1-4ed9-9f36-052d259f3d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87d3236-3dc1-4ed9-9f36-052d259f3d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d73366-017f-4b00-a434-c33809ec3f54', 'volume_name': 'volume-d9d73366-017f-4b00-a434-c33809ec3f54', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c1befb-6813-4903-891c-a3016d525414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c1befb-6813-4903-891c-a3016d525414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3837811b-5b69-4fa1-8026-6161ab835f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Volume d9d73366-017f-4b00-a434-c33809ec3f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d73366-017f-4b00-a434-c33809ec3f54', 'volume_size': 1} Jul 10 06:47:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:49 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690 1073741824" returned: 0 in 0.934s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:49 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690 Jul 10 06:47:49 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:49 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690" returned: 0 in 0.664s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.480s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259005154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9293c049-fd5d-40e2-a4e2-7e7300938826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:44Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Creating volume 9293c049-fd5d-40e2-a4e2-7e7300938826 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:49 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:50 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826 1073741824 Jul 10 06:47:50 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0669d0f4-1879-4fd7-baed-6ebe3af01261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ebf531-bc38-4ff7-bbe2-54ba0be01105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:50 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Volume volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690 (6df74c7f-30fe-4b94-b7f2-fcdc26e53690): created successfully Jul 10 06:47:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ebf531-bc38-4ff7-bbe2-54ba0be01105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Flow 'volume_create_manager' (a538748a-3bd5-47a9-aa62-d16e66c0bd3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bb59f8d6-92bd-4259-87b9-15c7ffbb65e0 tempest-GroupsTest-1060018464 None] Created volume successfully. Jul 10 06:47:50 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826 1073741824" returned: 0 in 0.871s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:50 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826 Jul 10 06:47:50 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:51 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826" returned: 0 in 0.729s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.909s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1382756622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b78e4c4-83f4-43b7-81d5-5db3607f8476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:44Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Creating volume 3b78e4c4-83f4-43b7-81d5-5db3607f8476 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:51 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e6e4942-e718-48dd-a964-6dc8e626a1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9293c049-fd5d-40e2-a4e2-7e7300938826', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:51 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476 1073741824 Jul 10 06:47:51 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53abd35-2fb9-4d7c-ab3e-e5f209fb709c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:51 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume volume-9293c049-fd5d-40e2-a4e2-7e7300938826 (9293c049-fd5d-40e2-a4e2-7e7300938826): created successfully Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53abd35-2fb9-4d7c-ab3e-e5f209fb709c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (ab577a84-ec56-4c19-9360-215adaf4b286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4d8d8bfb-395a-463d-bd64-5f66f3f6c863 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created volume successfully. Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Acquiring lock "cinder-quobyte-6df74c7f-30fe-4b94-b7f2-fcdc26e53690" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Lock "cinder-quobyte-6df74c7f-30fe-4b94-b7f2-fcdc26e53690" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0de089-18a2-4b67-abc2-83849303948d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:52 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690 Jul 10 06:47:52 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:52 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476 1073741824" returned: 0 in 1.004s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:52 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476 Jul 10 06:47:52 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:52 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:52 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690 Jul 10 06:47:52 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:53 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476" returned: 0 in 0.747s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.642s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2138759950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08804770845d4c549a382767a689213b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:45Z,use_quota=True,user_id='efd3dee044144d3b870c81bf846664bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Creating volume 847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:53 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:53 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6df74c7f-30fe-4b94-b7f2-fcdc26e53690" returned: 0 in 0.701s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:53 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b 1073741824 Jul 10 06:47:53 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd79c5a3-60a8-4300-a10c-463b795e36c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c81abd9-fa68-42cf-a491-da5750830d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Lock "cinder-quobyte-6df74c7f-30fe-4b94-b7f2-fcdc26e53690" released by "delete_volume" :: held 1.639s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476 (3b78e4c4-83f4-43b7-81d5-5db3607f8476): created successfully Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c81abd9-fa68-42cf-a491-da5750830d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (38cf23d3-d945-452b-b094-97228bef6091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-204a1210-07d1-4418-bd31-d745156c8745 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created volume successfully. Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Created reservations ['736bb60f-1663-4200-ad51-fd74c9c94b8d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:53 devstack cinder-volume[86966]: WARNING cinder.quota [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-352226551 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-352226551, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:47:53 devstack cinder-volume[86966]: WARNING cinder.quota [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-352226551 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-352226551, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Created reservations ['d8d62808-636d-4676-814d-e5f461a82b23', '279dadd1-1159-46d3-9e88-e69e5b417378', '80ee106d-dcf9-45c5-910c-42383dfc37f3', '5445ce66-bccb-43ab-b46a-320a6d95ffd3'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:53 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:47:53 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:54 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-069978a9-b5eb-48ac-a8ed-5c0333e68f04 tempest-GroupsTest-1060018464 None] Created reservations ['9f504544-d720-42af-84e4-e72639e4f94b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-069978a9-b5eb-48ac-a8ed-5c0333e68f04 tempest-GroupsTest-1060018464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:54 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-069978a9-b5eb-48ac-a8ed-5c0333e68f04 tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-069978a9-b5eb-48ac-a8ed-5c0333e68f04 tempest-GroupsTest-1060018464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-069978a9-b5eb-48ac-a8ed-5c0333e68f04 tempest-GroupsTest-1060018464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-069978a9-b5eb-48ac-a8ed-5c0333e68f04 tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-069978a9-b5eb-48ac-a8ed-5c0333e68f04 tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b 1073741824" returned: 0 in 1.022s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:54 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:47:54 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:54 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:54 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6f6fa790-3251-4114-9671-bcf2a4d97be0 tempest-GroupsTest-1060018464 None] Delete group completed successfully. Jul 10 06:47:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:54 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b Jul 10 06:47:54 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:55 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-069978a9-b5eb-48ac-a8ed-5c0333e68f04 tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.709s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-069978a9-b5eb-48ac-a8ed-5c0333e68f04 tempest-GroupsTest-1060018464 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:55 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-069978a9-b5eb-48ac-a8ed-5c0333e68f04 tempest-GroupsTest-1060018464 None] Delete group completed successfully. Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b" returned: 0 in 0.661s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.675s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1357168593',display_name='tempest-VolumesGetTest-Volume-8429339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d73366-017f-4b00-a434-c33809ec3f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:48Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Creating volume d9d73366-017f-4b00-a434-c33809ec3f54 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:55 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd99bee-ae4a-40ac-a1a4-a42ee7861c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:55 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54 1073741824 Jul 10 06:47:55 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fabbf18-a933-4048-967b-3d2d298af179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:55 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Volume volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b (847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b): created successfully Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fabbf18-a933-4048-967b-3d2d298af179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Flow 'volume_create_manager' (48bca3a5-2e0c-4f51-b8e5-271b488ca6bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-57cc5bbf-6133-4206-abf8-30311934ce72 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created volume successfully. Jul 10 06:47:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fca0e63c-367e-40af-bd79-0d9a53333ed9 tempest-GroupsTest-1060018464 None] Group tempest-GroupsTest-Group-146228766: creating Jul 10 06:47:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-quobyte-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fca0e63c-367e-40af-bd79-0d9a53333ed9 tempest-GroupsTest-1060018464 None] Group tempest-GroupsTest-Group-146228766: created successfully Jul 10 06:47:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fca0e63c-367e-40af-bd79-0d9a53333ed9 tempest-GroupsTest-1060018464 None] Create group completed successfully. Jul 10 06:47:56 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fab2b1-b279-43fd-8be8-0a1267c947e8]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:56 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54 1073741824" returned: 0 in 1.103s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:56 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54 Jul 10 06:47:56 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:56 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b Jul 10 06:47:56 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:57 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54" returned: 0 in 0.705s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:57 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3837811b-5b69-4fa1-8026-6161ab835f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d73366-017f-4b00-a434-c33809ec3f54', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c4d9d0-bb9e-4b29-b3fb-a9470db29ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b" returned: 0 in 0.804s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Volume volume-d9d73366-017f-4b00-a434-c33809ec3f54 (d9d73366-017f-4b00-a434-c33809ec3f54): created successfully Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c4d9d0-bb9e-4b29-b3fb-a9470db29ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:57 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b Jul 10 06:47:57 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (1ec3cd43-51e9-4d4e-a9f4-b925d3cad32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-946bff87-4e0e-4f60-92f3-227f38a365db tempest-VolumesGetTest-671559070 None] Created volume successfully. Jul 10 06:47:57 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Flow 'volume_create_manager' (15a0da70-8d75-44c8-b62e-c7aaf90634fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9540979c-c14b-44ff-b612-7502dd0cc85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b" returned: 0 in 0.784s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9540979c-c14b-44ff-b612-7502dd0cc85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-850584947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acdeee00-275f-4c51-9ac0-36f19528dbfa,host='devstack@QuobyteHD#QuobyteHD',id=43499688-aa47-44d8-817c-2255fd760a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3419d19c993646b58fa2001ce9689323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:58Z,use_quota=True,user_id='2044f5e8c9e845cd909805ca97ff524c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff80ce44-cbdb-4c8b-b6de-fdadf9e0c91d),volume_type_id=ff80ce44-cbdb-4c8b-b6de-fdadf9e0c91d)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93af79db-f497-4ee3-93c0-b9affe60efae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93af79db-f497-4ee3-93c0-b9affe60efae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5269d8-88e4-4a68-b2c1-fef59c7a2c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5269d8-88e4-4a68-b2c1-fef59c7a2c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43499688-aa47-44d8-817c-2255fd760a48', 'volume_name': 'volume-43499688-aa47-44d8-817c-2255fd760a48', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8944369-0467-4bf7-a723-ec02facbf365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8944369-0467-4bf7-a723-ec02facbf365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49a8e01-0d4c-44ae-a938-50932ecbf1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Volume 43499688-aa47-44d8-817c-2255fd760a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43499688-aa47-44d8-817c-2255fd760a48', 'volume_size': 1} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=acdeee00-275f-4c51-9ac0-36f19528dbfa,created_at=2026-07-10T04:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-850584947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acdeee00-275f-4c51-9ac0-36f19528dbfa,host='devstack@QuobyteHD#QuobyteHD',id=43499688-aa47-44d8-817c-2255fd760a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3419d19c993646b58fa2001ce9689323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:58Z,use_quota=True,user_id='2044f5e8c9e845cd909805ca97ff524c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff80ce44-cbdb-4c8b-b6de-fdadf9e0c91d),volume_type_id=ff80ce44-cbdb-4c8b-b6de-fdadf9e0c91d)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Creating volume 43499688-aa47-44d8-817c-2255fd760a48 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:57 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:47:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b" released by "delete_volume" :: held 1.756s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:58 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48 1073741824 Jul 10 06:47:58 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created reservations ['904e9000-fd74-4b11-812c-f512105303a8', '2b3b8b02-0ec7-4d3b-bb53-ef1f03e6de0d', 'a62a44eb-456e-4c0c-bf81-06d2b7551071', '1b90aa78-1a0d-4025-b40c-367798c382ce'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-d9d73366-017f-4b00-a434-c33809ec3f54-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Lock "cinder-d9d73366-017f-4b00-a434-c33809ec3f54-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:58 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:47:58 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-quobyte-d9d73366-017f-4b00-a434-c33809ec3f54" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-d9d73366-017f-4b00-a434-c33809ec3f54" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[856a23f3-1641-47e0-abea-c06dcc13e20c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-9293c049-fd5d-40e2-a4e2-7e7300938826-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:58 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54 Jul 10 06:47:58 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-9293c049-fd5d-40e2-a4e2-7e7300938826-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-quobyte-9293c049-fd5d-40e2-a4e2-7e7300938826" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-9293c049-fd5d-40e2-a4e2-7e7300938826" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff88efa-7bf2-4107-b6fb-791a31d18d35]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:58 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826 Jul 10 06:47:58 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:58 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48 1073741824" returned: 0 in 0.965s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:59 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48 Jul 10 06:47:59 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:59 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.923s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Deleted volume successfully. Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-54702c60-7151-4720-8d39-22db8921ff1a tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-847fdd7c-13dc-46c2-ba41-4bdeb3ce7a5b-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:59 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54" returned: 0 in 1.028s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:59 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54 Jul 10 06:47:59 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-265cef7f-fbd7-4472-a573-232ccf4dca4d req-f7a3ff4f-d844-4ef7-8532-128cc6198bcd tempest-AttachVolumeTestJSON-1394904718 None] Terminate volume connection completed successfully. Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-265cef7f-fbd7-4472-a573-232ccf4dca4d req-f7a3ff4f-d844-4ef7-8532-128cc6198bcd tempest-AttachVolumeTestJSON-1394904718 None] Deleting attachment aa4a3175-1945-4c0f-9838-e4f93bbcf2a1. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:47:59 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826" returned: 0 in 1.069s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:59 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826 Jul 10 06:47:59 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:59 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48" returned: 0 in 0.866s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49a8e01-0d4c-44ae-a938-50932ecbf1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43499688-aa47-44d8-817c-2255fd760a48', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd753ef2-ae96-4f2b-a94f-1406cf829e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:59 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Volume volume-43499688-aa47-44d8-817c-2255fd760a48 (43499688-aa47-44d8-817c-2255fd760a48): created successfully Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd753ef2-ae96-4f2b-a94f-1406cf829e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Flow 'volume_create_manager' (15a0da70-8d75-44c8-b62e-c7aaf90634fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-71ee7b00-4002-484e-b78a-3832ec8aaa54 tempest-GroupsTest-1060018464 None] Created volume successfully. Jul 10 06:48:00 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d9d73366-017f-4b00-a434-c33809ec3f54" returned: 0 in 0.733s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-d9d73366-017f-4b00-a434-c33809ec3f54" released by "delete_volume" :: held 1.818s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Created reservations ['578c2fe8-30dc-4385-8acb-f1d3aebbe544', '0667505e-a999-41cc-acc6-c63670272a44', '50a3ccf5-34f2-4b0b-a7cf-812ee55291d5', 'adf377dd-8c44-46be-a322-9c79c22be457'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:00 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:00 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:00 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9293c049-fd5d-40e2-a4e2-7e7300938826" returned: 0 in 0.727s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-9293c049-fd5d-40e2-a4e2-7e7300938826" released by "delete_volume" :: held 1.844s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created reservations ['b193a947-134d-4fa0-a7d6-8f7309dd0edc', '2a507ba0-c2e3-4f16-8305-5994bf90ce44', '4ac5216c-9143-446d-a580-ce8b8c7c3afb', '6cab671b-818f-47c5-8fa3-ddf1b2726753'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-ddb10e35-7e43-42c2-8e9d-326539c9617c-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:00 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:00 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Lock "cinder-ddb10e35-7e43-42c2-8e9d-326539c9617c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-quobyte-ddb10e35-7e43-42c2-8e9d-326539c9617c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-ddb10e35-7e43-42c2-8e9d-326539c9617c" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-3b78e4c4-83f4-43b7-81d5-5db3607f8476-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b853a0fd-c681-46a6-a752-f7f4b3c4d49b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-3b78e4c4-83f4-43b7-81d5-5db3607f8476-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:01 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.856s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Deleted volume successfully. Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-quobyte-3b78e4c4-83f4-43b7-81d5-5db3607f8476" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d785fda9-f22a-4e2b-b38e-83845e8fe8bb tempest-VolumesGetTest-671559070 None] Lock "cinder-d9d73366-017f-4b00-a434-c33809ec3f54-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:01 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-3b78e4c4-83f4-43b7-81d5-5db3607f8476" acquired by "delete_volume" :: waited 0.067s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:01 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1e64c4-b096-494a-8240-c0252a565412]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:01 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476 Jul 10 06:48:01 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Flow 'volume_create_manager' (3e2be4db-f2f7-414e-9a58-981be06726ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b500da-a003-4d22-97ab-9e4c8aae3e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b500da-a003-4d22-97ab-9e4c8aae3e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671949741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acdeee00-275f-4c51-9ac0-36f19528dbfa,host='devstack@QuobyteHD#QuobyteHD',id=e6c0b370-667e-4e34-8a99-fdf8e19ebb2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3419d19c993646b58fa2001ce9689323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:01Z,use_quota=True,user_id='2044f5e8c9e845cd909805ca97ff524c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff80ce44-cbdb-4c8b-b6de-fdadf9e0c91d),volume_type_id=ff80ce44-cbdb-4c8b-b6de-fdadf9e0c91d)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718a5b04-9b43-49f5-b78d-999637366215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718a5b04-9b43-49f5-b78d-999637366215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caaffcfe-be11-417d-83ff-0b792c306fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caaffcfe-be11-417d-83ff-0b792c306fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c0b370-667e-4e34-8a99-fdf8e19ebb2a', 'volume_name': 'volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ee885d-6ff3-40c4-8c2e-fd1fb330d953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ee885d-6ff3-40c4-8c2e-fd1fb330d953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb1df58-66da-4f4a-bed0-30442ad64904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:01 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Volume e6c0b370-667e-4e34-8a99-fdf8e19ebb2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a', 'volume_size': 1} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=acdeee00-275f-4c51-9ac0-36f19528dbfa,created_at=2026-07-10T04:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-671949741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acdeee00-275f-4c51-9ac0-36f19528dbfa,host='devstack@QuobyteHD#QuobyteHD',id=e6c0b370-667e-4e34-8a99-fdf8e19ebb2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3419d19c993646b58fa2001ce9689323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:01Z,use_quota=True,user_id='2044f5e8c9e845cd909805ca97ff524c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff80ce44-cbdb-4c8b-b6de-fdadf9e0c91d),volume_type_id=ff80ce44-cbdb-4c8b-b6de-fdadf9e0c91d)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Creating volume e6c0b370-667e-4e34-8a99-fdf8e19ebb2a {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:48:01 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:01 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a 1073741824 Jul 10 06:48:01 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:01 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.199s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Deleted volume successfully. Jul 10 06:48:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b8274b78-a60b-4edb-8f75-5f1068701502 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-9293c049-fd5d-40e2-a4e2-7e7300938826-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:02 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c" returned: 0 in 1.071s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:02 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c Jul 10 06:48:02 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:02 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476" returned: 0 in 0.969s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:02 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476 Jul 10 06:48:02 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:02 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a 1073741824" returned: 0 in 1.096s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:02 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a Jul 10 06:48:02 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:02 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ddb10e35-7e43-42c2-8e9d-326539c9617c" returned: 0 in 0.783s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-ddb10e35-7e43-42c2-8e9d-326539c9617c" released by "delete_volume" :: held 1.954s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:02 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Created reservations ['9e5df248-9f03-4fe2-afc2-b5a7f56ee4d4', '4200ffe1-07a9-45f4-9a9a-b61d619d2a8a', '08ca655a-b4f7-4d51-b0a1-353ff492ff7d', 'da6487b2-c9c4-47b6-abb2-0da053fd31b2'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:03 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3b78e4c4-83f4-43b7-81d5-5db3607f8476" returned: 0 in 0.801s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-3b78e4c4-83f4-43b7-81d5-5db3607f8476" released by "delete_volume" :: held 1.856s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:03 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:03 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created reservations ['23df964f-7596-4f1d-b240-53fe28cde70a', 'cfb3b0cd-2cd2-417a-a4db-438c735592f3', 'd1955553-82ce-4c06-b90c-dd1cbf479104', '70daaeb1-38c9-46d6-ad17-622f8dace639'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:03 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:03 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:03 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a" returned: 0 in 0.844s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-quobyte-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb1df58-66da-4f4a-bed0-30442ad64904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cb995e-dc4f-4632-9f4e-f0b1848d3da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4" acquired by "delete_volume" :: waited 0.046s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:03 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Volume volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a (e6c0b370-667e-4e34-8a99-fdf8e19ebb2a): created successfully Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2cb995e-dc4f-4632-9f4e-f0b1848d3da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Flow 'volume_create_manager' (3e2be4db-f2f7-414e-9a58-981be06726ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bc62245a-2c40-47a6-843a-1d63455ba713 tempest-GroupsTest-1060018464 None] Created volume successfully. Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff547d86-4521-4d0a-814a-bc86e74798ed]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:03 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4 Jul 10 06:48:03 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (74b11c9f-e325-41de-889d-b54ab4cc2bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e62d654-9c2f-4216-9dc2-65fcf2f382d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e62d654-9c2f-4216-9dc2-65fcf2f382d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1729616357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad999f7-c069-4525-905a-617e8487f5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:04Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700b83ec-c212-46b1-820d-c325933ba307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700b83ec-c212-46b1-820d-c325933ba307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe8d2aa-2237-46f2-88ce-5a220bdcb10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe8d2aa-2237-46f2-88ce-5a220bdcb10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad999f7-c069-4525-905a-617e8487f5ce', 'volume_name': 'volume-bad999f7-c069-4525-905a-617e8487f5ce', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a20b014-f319-4df4-b788-45e056b11803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a20b014-f319-4df4-b788-45e056b11803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d0b904-e513-49dc-8381-9d0ae5ba9fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Volume bad999f7-c069-4525-905a-617e8487f5ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad999f7-c069-4525-905a-617e8487f5ce', 'volume_size': 1} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1729616357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad999f7-c069-4525-905a-617e8487f5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:04Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Creating volume bad999f7-c069-4525-905a-617e8487f5ce {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:48:04 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:04 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce 1073741824 Jul 10 06:48:04 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0d83b0db-bfcb-483d-b7fc-bca7a5d1473a tempest-GroupsTest-1060018464 None] Update group completed successfully. Jul 10 06:48:04 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.034s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Deleted volume successfully. Jul 10 06:48:04 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.350s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Deleted volume successfully. Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8d055f83-d17b-4891-9beb-848bfff3b67d tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-3b78e4c4-83f4-43b7-81d5-5db3607f8476-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe619200-fb76-465e-94c6-1bcc98f68480 tempest-VolumesGetTest-671559070 None] Lock "cinder-ddb10e35-7e43-42c2-8e9d-326539c9617c-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:04 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4" returned: 0 in 1.239s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:04 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4 Jul 10 06:48:04 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:05 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce 1073741824" returned: 0 in 1.018s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:05 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce Jul 10 06:48:05 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-457d8bfc-a1e4-4805-9084-e2b7174fc7b0 tempest-GroupsTest-1060018464 None] Update group completed successfully. Jul 10 06:48:05 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4" returned: 0 in 0.770s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4" released by "delete_volume" :: held 2.102s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created reservations ['aeae8c50-474e-4c73-ac10-818d397691df', 'ed41f160-43b1-4196-bfb7-322c10e9f9bf', '1e15935c-2ed8-4667-98db-b2789e7bddb2', 'e5ef65c8-b750-4925-a13e-56af2ca7ec63'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:05 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:05 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:05 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce" returned: 0 in 0.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:48:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d0b904-e513-49dc-8381-9d0ae5ba9fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad999f7-c069-4525-905a-617e8487f5ce', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91529ee-28d0-4a08-be84-7c5897a10790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Volume volume-bad999f7-c069-4525-905a-617e8487f5ce (bad999f7-c069-4525-905a-617e8487f5ce): created successfully Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91529ee-28d0-4a08-be84-7c5897a10790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (74b11c9f-e325-41de-889d-b54ab4cc2bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e8b0b163-c23e-4ac6-b300-00ebbf0317eb tempest-VolumesGetTest-671559070 None] Created volume successfully. Jul 10 06:48:06 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.700s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Deleted volume successfully. Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-aebf98a9-c09e-438d-ad12-d7693f638d2b tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-df4dfaf9-ceeb-4822-a90f-6a5acc1cbca4-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-64d3ab19-8991-4247-8fd9-99156b9fc79c-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-64d3ab19-8991-4247-8fd9-99156b9fc79c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-quobyte-64d3ab19-8991-4247-8fd9-99156b9fc79c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-64d3ab19-8991-4247-8fd9-99156b9fc79c" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9179a1-dbc0-44db-92bd-c7d071dd78f9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:07 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c Jul 10 06:48:07 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Acquiring lock "cinder-quobyte-43499688-aa47-44d8-817c-2255fd760a48" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Lock "cinder-quobyte-43499688-aa47-44d8-817c-2255fd760a48" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e856a7-d0fa-4965-aa1a-9b1251c2550c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:07 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48 Jul 10 06:48:07 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (eddf01db-f376-46cd-81f7-08c005b7b4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9de0cae-da72-46e3-b786-dd9f5a70990b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9de0cae-da72-46e3-b786-dd9f5a70990b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1185332936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=bad999f7-c069-4525-905a-617e8487f5ce,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:08Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0746d1e-edba-401b-9bd2-5722b9718a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0746d1e-edba-401b-9bd2-5722b9718a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0461ec10-3137-45c2-b70d-fae5e2cfd84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0461ec10-3137-45c2-b70d-fae5e2cfd84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf', 'volume_name': 'volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf', 'volume_size': 1, 'source_volid': 'bad999f7-c069-4525-905a-617e8487f5ce', 'source_volstatus': 'available'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b2e317-4a44-42cd-b983-8ddf9dee7f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b2e317-4a44-42cd-b983-8ddf9dee7f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a07871-3d88-44df-8d14-455ac8735d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Volume 204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf', 'volume_size': 1, 'source_volid': 'bad999f7-c069-4525-905a-617e8487f5ce', 'source_volstatus': 'available'} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:07 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Cloning volume bad999f7-c069-4525-905a-617e8487f5ce to volume 204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Creating offline snapshot ce6617a9-4b4d-4fec-be94-f3bbde095a0d of volume bad999f7-c069-4525-905a-617e8487f5ce {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf2d850-b35c-4844-ad20-edff90b6a28f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:07 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c" returned: 0 in 0.972s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:07 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c Jul 10 06:48:07 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:07 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce Jul 10 06:48:07 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:08 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48" returned: 0 in 0.822s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:08 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48 Jul 10 06:48:08 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:08 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64d3ab19-8991-4247-8fd9-99156b9fc79c" returned: 0 in 0.731s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-64d3ab19-8991-4247-8fd9-99156b9fc79c" released by "delete_volume" :: held 1.755s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created reservations ['a3a738cf-885c-4630-89b9-d2afce1a7ad4', 'b3f29ee7-9c74-4849-b8a7-cfcad2f9a8c1', '84c930f7-62f2-46a7-b43d-5131e603a85c', '727a0cc8-b412-4a98-a2b2-ddf6c973bdb0'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:08 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:08 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:08 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce" returned: 0 in 0.963s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:08 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d 1G Jul 10 06:48:08 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:09 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-e1e58bdd-03bc-4081-975b-fd33f0aa81d8-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-43499688-aa47-44d8-817c-2255fd760a48" returned: 0 in 0.821s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Lock "cinder-quobyte-43499688-aa47-44d8-817c-2255fd760a48" released by "delete_volume" :: held 1.729s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Acquiring lock "cinder-quobyte-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-e1e58bdd-03bc-4081-975b-fd33f0aa81d8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Lock "cinder-quobyte-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a" acquired by "delete_volume" :: waited 0.037s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[25447ed0-34c0-4a3d-89d6-0ce697abf7de]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "cinder-quobyte-e1e58bdd-03bc-4081-975b-fd33f0aa81d8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-e1e58bdd-03bc-4081-975b-fd33f0aa81d8" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb323b60-01f3-45de-ae85-fcd2fff642eb]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:09 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a Jul 10 06:48:09 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:09 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8 Jul 10 06:48:09 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:09 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.061s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Deleted volume successfully. Jul 10 06:48:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d5d9aa2-c60e-4e43-ab49-0271eb81f00c tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-64d3ab19-8991-4247-8fd9-99156b9fc79c-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:10 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d 1G" returned: 0 in 1.264s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad999f7-c069-4525-905a-617e8487f5ce -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:10 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad999f7-c069-4525-905a-617e8487f5ce -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d Jul 10 06:48:10 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:10 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a" returned: 0 in 1.242s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:10 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a Jul 10 06:48:10 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:10 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8" returned: 0 in 1.327s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:10 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8 Jul 10 06:48:10 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:11 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bad999f7-c069-4525-905a-617e8487f5ce -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d" returned: 0 in 0.946s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:11 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d is being set with open permissions: ugo+rw Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:11 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d Jul 10 06:48:11 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:11 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a" returned: 0 in 0.744s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Lock "cinder-quobyte-e6c0b370-667e-4e34-8a99-fdf8e19ebb2a" released by "delete_volume" :: held 2.044s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Created reservations ['d5a2635e-6daf-48c2-b3f5-617b4a5afb5b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:11 devstack cinder-volume[86966]: WARNING cinder.quota [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1631613800 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1631613800, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:11 devstack cinder-volume[86966]: WARNING cinder.quota [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1631613800 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1631613800, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Created reservations ['d233494c-8df2-4033-bf8e-b7233fe9c905', '4cbcdd69-d1e0-4e1b-ac01-7efae8168c32', '19c72fef-87d6-4f68-a12c-1e74b9c7ddaf', 'eae5b497-1a24-4d13-ada8-03b4fd6640df'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:11 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e1e58bdd-03bc-4081-975b-fd33f0aa81d8" returned: 0 in 0.877s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-quobyte-e1e58bdd-03bc-4081-975b-fd33f0aa81d8" released by "delete_volume" :: held 2.252s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Created reservations ['659f3812-db1d-4829-9b51-d74531352d05', '0e9944f2-016f-4e0d-8fb6-c5ceacd23d69', '88efe829-050b-4a40-9199-f3ec98f05ab2', 'f87a000e-7e8b-4114-a3e9-bdcc8b38d94f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Created reservations ['7a9edabc-e10f-47cf-aad6-6b513a3efbd0', '2841825b-34a0-4c54-ba80-3f6a39d3203e', '514b78d8-07b7-4f00-a8f2-936eb3791e43', '09d86a88-78fb-42f2-96f6-729060241507'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:11 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:11 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:11 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:11 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:11 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:11 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:11 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d" returned: 0 in 0.975s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:12 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.info Jul 10 06:48:12 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:12 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.938s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:48:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:48:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:48:13 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.379s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:13 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:13 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b61937a5-ec06-4393-9b96-c743dcb72cff tempest-GroupsTest-1060018464 None] Delete group completed successfully. Jul 10 06:48:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.392s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:13 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Deleted volume successfully. Jul 10 06:48:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a835d818-5a6e-4951-92e5-9d0ed6418440 tempest-CreateVolumesFromSourceVolumeTest-1967056279 None] Lock "cinder-e1e58bdd-03bc-4081-975b-fd33f0aa81d8-delete_volume" released by "delete_volume" :: held 4.057s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:13 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.info" returned: 0 in 1.490s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:13 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.info is being set with open permissions: ugo+rw Jul 10 06:48:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:13 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.info Jul 10 06:48:13 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:14 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.info" returned: 0 in 1.117s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-quobyte-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] snapshot: ce6617a9-4b4d-4fec-be94-f3bbde095a0d, volume: 204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:48:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96556e4-bb78-4c23-922a-8e5e948574d2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:14 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d Jul 10 06:48:14 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:15 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d" returned: 0 in 1.260s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bad999f7-c069-4525-905a-617e8487f5ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:48:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:48:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:48:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[09215899-e33e-4965-b50b-34d5d76d99b2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:16 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce Jul 10 06:48:16 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:17 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce" returned: 0 in 1.257s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:17 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:48:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:17 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf Jul 10 06:48:17 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:22 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=112,cinder:INSERT=27,cinder:UPDATE=144,cinder:DELETE=9 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:48:23 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=105,cinder:INSERT=38,cinder:UPDATE=146,cinder:DELETE=12 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:48:25 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf" returned: 0 in 7.705s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29aa80c-9d5d-4f51-97ec-bd193478303f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:25 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce Jul 10 06:48:25 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Flow 'volume_create_manager' (63d2d13c-6b7f-400b-84a1-e64df93857f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3bf83b-9666-402b-b749-09a3a7561a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3bf83b-9666-402b-b749-09a3a7561a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd895de116704e59b54c746d028cbeeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:25Z,use_quota=True,user_id='31cdd31c1618423983aef4585966b34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ae3885-d679-4658-bbb2-bda755678bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ae3885-d679-4658-bbb2-bda755678bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b14568-1ff9-4470-bafb-b0b2e668dba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b14568-1ff9-4470-bafb-b0b2e668dba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4', 'volume_name': 'volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4', 'volume_size': 1, 'image_id': 'b5ea503a-79cc-40a2-952f-b0de4624bd56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5ea503a-79cc-40a2-952f-b0de4624bd56', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09076dff5e9f70f031d228300d024ec4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd895de116704e59b54c746d028cbeeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '582bb3d35bc6d3bbbbf4687958a809837fb4647d2e18eee3cafb655572ff0acde33317b4251ecb8fa59731b00e2be3443f0b9a039b1efd88ec5e45825f068fdf', 'id': 'b5ea503a-79cc-40a2-952f-b0de4624bd56', 'created_at': datetime.datetime(2026, 7, 10, 4, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 48, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5ea503a-79cc-40a2-952f-b0de4624bd56/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c037bdff-e356-46e8-9bb3-024b8a9fb281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c037bdff-e356-46e8-9bb3-024b8a9fb281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6846b581-0812-4170-87a0-d573b04056fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Volume e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4', 'volume_size': 1, 'image_id': 'b5ea503a-79cc-40a2-952f-b0de4624bd56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5ea503a-79cc-40a2-952f-b0de4624bd56', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09076dff5e9f70f031d228300d024ec4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd895de116704e59b54c746d028cbeeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '582bb3d35bc6d3bbbbf4687958a809837fb4647d2e18eee3cafb655572ff0acde33317b4251ecb8fa59731b00e2be3443f0b9a039b1efd88ec5e45825f068fdf', 'id': 'b5ea503a-79cc-40a2-952f-b0de4624bd56', 'created_at': datetime.datetime(2026, 7, 10, 4, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 48, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5ea503a-79cc-40a2-952f-b0de4624bd56/file', 'properties': {}}, 'image_service': } Jul 10 06:48:26 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Trying to clone e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 from image b5ea503a-79cc-40a2-952f-b0de4624bd56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5ea503a-79cc-40a2-952f-b0de4624bd56', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:48:26 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:48:26 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Image download 0.00 MB at 0.00 MB/s Jul 10 06:48:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29e3b6d-30ea-4dbe-8179-559edb29b9a7]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:26 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD Jul 10 06:48:26 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:26 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce" returned: 0 in 1.447s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:26 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce, size 1024.00 MB, duration 7.71 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:48:26 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Converted 1024.00 MB image at 132.87 MB/s Jul 10 06:48:26 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf is being set with open permissions: ugo+rw Jul 10 06:48:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:26 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf Jul 10 06:48:26 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:27 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:27 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf" returned: 0 in 0.764s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf" released by "_copy_volume_from_snapshot" :: held 12.577s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-quobyte-ce6617a9-4b4d-4fec-be94-f3bbde095a0d" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:27 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD Jul 10 06:48:27 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-ce6617a9-4b4d-4fec-be94-f3bbde095a0d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Deleting offline snapshot ce6617a9-4b4d-4fec-be94-f3bbde095a0d of volume bad999f7-c069-4525-905a-617e8487f5ce {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:48:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] snapshot_file for this snap is: volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:48:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d3138d-0ecf-40e9-9674-e9a019261a86]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:27 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d Jul 10 06:48:27 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:27 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD" returned: 1 in 0.827s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:48:28 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Temporary image b5ea503a-79cc-40a2-952f-b0de4624bd56 is fetched for user 31cdd31c1618423983aef4585966b34c. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:48:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda7cc37-99f4-4192-8033-b5dbf457cd1d]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:28 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:28 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD Jul 10 06:48:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d" returned: 0 in 0.895s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bad999f7-c069-4525-905a-617e8487f5ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:48:28 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[050c0ae1-31b1-4942-be4e-f53ede626c54]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:28 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce Jul 10 06:48:28 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:28 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD" returned: 0 in 0.839s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:29 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD Jul 10 06:48:29 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:29 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce" returned: 0 in 0.850s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:29 devstack sudo[95903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d Jul 10 06:48:29 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:29 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD" returned: 1 in 0.858s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:48:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:29 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d" returned: 0 in 0.815s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:29 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d Jul 10 06:48:29 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:30 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce.ce6617a9-4b4d-4fec-be94-f3bbde095a0d" returned: 0 in 0.681s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-ce6617a9-4b4d-4fec-be94-f3bbde095a0d" released by "_delete_snapshot" :: held 3.372s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.929s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd895de116704e59b54c746d028cbeeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:25Z,use_quota=True,user_id='31cdd31c1618423983aef4585966b34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Creating volume e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:48:30 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a07871-3d88-44df-8d14-455ac8735d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf', 'volume_size': 1, 'source_volid': 'bad999f7-c069-4525-905a-617e8487f5ce', 'source_volstatus': 'available'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:30 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 1073741824 Jul 10 06:48:30 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8fbb2e-953a-4d4e-982f-9c1602e6eaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:30 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Volume volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf (204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf): created successfully Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8fbb2e-953a-4d4e-982f-9c1602e6eaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (eddf01db-f376-46cd-81f7-08c005b7b4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2c22b459-f853-450f-95d9-02409107bef3 tempest-VolumesGetTest-671559070 None] Created volume successfully. Jul 10 06:48:31 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 1073741824" returned: 0 in 0.942s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:31 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 Jul 10 06:48:31 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:32 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4" returned: 0 in 0.735s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Attempting download of b5ea503a-79cc-40a2-952f-b0de4624bd56 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5ea503a-79cc-40a2-952f-b0de4624bd56', 'metadata': {}}])) to volume e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ec4bd1-d1ce-4290-84da-853476d5f7b4]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5ea503a-79cc-40a2-952f-b0de4624bd56_2mhz49uf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:48:32 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5ea503a-79cc-40a2-952f-b0de4624bd56_2mhz49uf Jul 10 06:48:32 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (159cc030-74cb-49a4-bcbe-3d2a7270d170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169d3bd5-f61b-45de-8de0-b725ba79a129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169d3bd5-f61b-45de-8de0-b725ba79a129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2035882295',display_name='tempest-VolumesGetTest-Volume-408605432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afdf8e2e-d54b-45c4-a568-945f4ce9c622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:33Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ec13a4-5317-48b7-af39-9ddcfa6c5667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ec13a4-5317-48b7-af39-9ddcfa6c5667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973e661a-40e0-4fd1-ba8c-b8d78c2ebcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973e661a-40e0-4fd1-ba8c-b8d78c2ebcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afdf8e2e-d54b-45c4-a568-945f4ce9c622', 'volume_name': 'volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3a86f9-c891-4cee-9a2f-d2a99b0cdc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3a86f9-c891-4cee-9a2f-d2a99b0cdc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4849813d-52aa-4fa8-8064-f940ab45019d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:32 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Volume afdf8e2e-d54b-45c4-a568-945f4ce9c622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622', 'volume_size': 1} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2035882295',display_name='tempest-VolumesGetTest-Volume-408605432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afdf8e2e-d54b-45c4-a568-945f4ce9c622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:33Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Creating volume afdf8e2e-d54b-45c4-a568-945f4ce9c622 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:48:32 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:48:32 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622 1073741824 Jul 10 06:48:32 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Flow 'volume_create_manager' (4a16e30e-fc4f-4602-9f1d-fbf55b6710b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee427665-f6d6-4add-82da-822ee69e968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee427665-f6d6-4add-82da-822ee69e968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1624638814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3966e30a-7929-4a6e-94ef-0e5a4db8147a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be221717671f47d2a6723246b10ed656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:33Z,use_quota=True,user_id='a6952b41f81b42e78664752e8d75e31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59daecf-7b95-4aa3-86e7-741c58d90758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59daecf-7b95-4aa3-86e7-741c58d90758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b960d0-2426-4784-9d33-78a59f7ba99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b960d0-2426-4784-9d33-78a59f7ba99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3966e30a-7929-4a6e-94ef-0e5a4db8147a', 'volume_name': 'volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce5dac9-015d-4915-9810-75bebdc57428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce5dac9-015d-4915-9810-75bebdc57428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cff2e0-29e1-4ae4-b772-cca130d59050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:32 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a', 'volume_size': 1} Jul 10 06:48:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:33 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5ea503a-79cc-40a2-952f-b0de4624bd56_2mhz49uf" returned: 0 in 0.877s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5ea503a-79cc-40a2-952f-b0de4624bd56_2mhz49uf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:33 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5ea503a-79cc-40a2-952f-b0de4624bd56_2mhz49uf Jul 10 06:48:33 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:33 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622 1073741824" returned: 0 in 1.080s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:33 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622 Jul 10 06:48:33 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:34 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5ea503a-79cc-40a2-952f-b0de4624bd56_2mhz49uf" returned: 1 in 0.829s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5ea503a-79cc-40a2-952f-b0de4624bd56_2mhz49uf' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede6878b-aa7e-4318-b693-0611cb819b59]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:34 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD Jul 10 06:48:34 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:34 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622" returned: 0 in 0.717s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.695s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1624638814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3966e30a-7929-4a6e-94ef-0e5a4db8147a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be221717671f47d2a6723246b10ed656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:33Z,use_quota=True,user_id='a6952b41f81b42e78664752e8d75e31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Creating volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:48:34 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:34 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a 1073741824 Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4849813d-52aa-4fa8-8064-f940ab45019d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:34 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5faff3a6-d846-4fe8-b829-dc20222405f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:34 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Volume volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622 (afdf8e2e-d54b-45c4-a568-945f4ce9c622): created successfully Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5faff3a6-d846-4fe8-b829-dc20222405f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (159cc030-74cb-49a4-bcbe-3d2a7270d170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-18f5c45c-37b8-4624-a641-efd9874cf2a4 tempest-VolumesGetTest-671559070 None] Created volume successfully. Jul 10 06:48:35 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD" returned: 0 in 0.773s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:35 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD Jul 10 06:48:35 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:35 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a 1073741824" returned: 0 in 0.854s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:35 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a Jul 10 06:48:35 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-afdf8e2e-d54b-45c4-a568-945f4ce9c622-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Lock "cinder-afdf8e2e-d54b-45c4-a568-945f4ce9c622-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-quobyte-afdf8e2e-d54b-45c4-a568-945f4ce9c622" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-afdf8e2e-d54b-45c4-a568-945f4ce9c622" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:35 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD" returned: 1 in 0.828s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] b5ea503a-79cc-40a2-952f-b0de4624bd56 was raw, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e09b0c-1d81-42b3-8273-52eefae10f83]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:35 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 Jul 10 06:48:35 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:36 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622 Jul 10 06:48:36 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:36 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a" returned: 0 in 0.716s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cff2e0-29e1-4ae4-b772-cca130d59050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02155f5-de99-420a-b313-64956bd8251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:36 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Volume volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a (3966e30a-7929-4a6e-94ef-0e5a4db8147a): created successfully Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02155f5-de99-420a-b313-64956bd8251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Flow 'volume_create_manager' (4a16e30e-fc4f-4602-9f1d-fbf55b6710b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dc3bb889-e8ef-48a4-b277-77282cbaba72 tempest-SnapshotsActionsTest-180104588 None] Created volume successfully. Jul 10 06:48:36 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4" returned: 0 in 0.894s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5ea503a-79cc-40a2-952f-b0de4624bd56__dw_fekgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:48:36 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:36 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622" returned: 0 in 0.899s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:36 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 1G Jul 10 06:48:36 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:36 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622 Jul 10 06:48:36 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] Creating offline snapshot e33ac3ee-92b4-4fdd-98f7-0425016937d4 of volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9fbde3-2bf5-4969-bd8a-2fc083c74cb1]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:37 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a Jul 10 06:48:37 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:37 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-afdf8e2e-d54b-45c4-a568-945f4ce9c622" returned: 0 in 0.868s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-afdf8e2e-d54b-45c4-a568-945f4ce9c622" released by "delete_volume" :: held 1.825s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:37 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 1G" returned: 0 in 0.929s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda1561c-5ef8-4cbe-bf7a-86310c6569b0]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Created reservations ['b1125073-64d9-4709-9303-3989056cba20', '4af19820-1b33-4eb6-925a-8ea4348e4a36', '9fcfed56-3e42-475e-ab28-594cd5bd659c', '71cc2385-ce5a-4a2e-b8bd-6fa61538114c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:37 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:37 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:37 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 Jul 10 06:48:37 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:37 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a" returned: 0 in 0.904s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:38 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 1G Jul 10 06:48:38 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Lock "cinder-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-quobyte-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27509d3-f8cf-4a18-8810-3f6b8a1c6a07]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:38 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf Jul 10 06:48:38 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:38 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.896s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:38 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Deleted volume successfully. Jul 10 06:48:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c4aa39b6-4ba6-4024-ac65-31cfaa714817 tempest-VolumesGetTest-671559070 None] Lock "cinder-afdf8e2e-d54b-45c4-a568-945f4ce9c622-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:38 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4" returned: 0 in 1.113s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:39 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 Jul 10 06:48:39 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:39 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 1G" returned: 0 in 1.453s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:39 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:48:39 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:39 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf" returned: 0 in 1.290s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:39 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf Jul 10 06:48:39 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:39 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4" returned: 1 in 1.044s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:48:39 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Downloaded image b5ea503a-79cc-40a2-952f-b0de4624bd56 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5ea503a-79cc-40a2-952f-b0de4624bd56', 'metadata': {}}])) to volume e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:48:39 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Temporary image b5ea503a-79cc-40a2-952f-b0de4624bd56 for user 31cdd31c1618423983aef4585966b34c is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:48:39 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Marking volume e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:48:39 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Copying metadata from image b5ea503a-79cc-40a2-952f-b0de4624bd56 to e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:48:39 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Creating volume glance metadata for volume e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 backed by image b5ea503a-79cc-40a2-952f-b0de4624bd56 with: {'image_id': 'b5ea503a-79cc-40a2-952f-b0de4624bd56', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '09076dff5e9f70f031d228300d024ec4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6846b581-0812-4170-87a0-d573b04056fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4', 'volume_size': 1, 'image_id': 'b5ea503a-79cc-40a2-952f-b0de4624bd56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5ea503a-79cc-40a2-952f-b0de4624bd56', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '09076dff5e9f70f031d228300d024ec4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd895de116704e59b54c746d028cbeeb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '582bb3d35bc6d3bbbbf4687958a809837fb4647d2e18eee3cafb655572ff0acde33317b4251ecb8fa59731b00e2be3443f0b9a039b1efd88ec5e45825f068fdf', 'id': 'b5ea503a-79cc-40a2-952f-b0de4624bd56', 'created_at': datetime.datetime(2026, 7, 10, 4, 48, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 48, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5ea503a-79cc-40a2-952f-b0de4624bd56/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59aba35-11df-42b2-9edf-dee196551954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Volume volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 (e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4): created successfully Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59aba35-11df-42b2-9edf-dee196551954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Flow 'volume_create_manager' (63d2d13c-6b7f-400b-84a1-e64df93857f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4e4d07e1-7089-4690-b965-068a5265ba80 tempest-VolumeImageDependencyTests-1176280218 None] Created volume successfully. Jul 10 06:48:40 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 1.065s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:40 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 is being set with open permissions: ugo+rw Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:40 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:48:40 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:40 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Acquiring lock "cinder-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf" returned: 0 in 0.970s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf" released by "delete_volume" :: held 2.361s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Lock "cinder-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Acquiring lock "cinder-quobyte-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Created reservations ['0c621ddc-7d1a-43f8-884b-819ca5aeefda', 'd8d60b49-7fc5-4b31-b401-dd1292c02488', '7cb56144-e03b-4c04-972c-680c706f744c', '79cfe9dd-8e47-4152-b087-b5de15d4e51d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Lock "cinder-quobyte-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31cd1cf-19d6-48ca-858b-be7e5d48cbea]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:40 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:40 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:40 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 Jul 10 06:48:40 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:41 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:41 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.info Jul 10 06:48:41 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-bad999f7-c069-4525-905a-617e8487f5ce-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Lock "cinder-bad999f7-c069-4525-905a-617e8487f5ce-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:41 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-quobyte-bad999f7-c069-4525-905a-617e8487f5ce" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.826s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:41 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Deleted volume successfully. Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-bad999f7-c069-4525-905a-617e8487f5ce" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:41 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4" returned: 0 in 0.933s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[066a59ff-7817-4b6b-96c4-fb5fa609ad2d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-759a83d2-6557-4a49-98a5-a4bdc3f23148 tempest-VolumesGetTest-671559070 None] Lock "cinder-204f4f4f-9cc3-4cf1-b2e0-37e6538e18bf-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:41 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 Jul 10 06:48:41 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:41 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce Jul 10 06:48:41 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:42 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.info" returned: 0 in 0.858s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:42 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.info is being set with open permissions: ugo+rw Jul 10 06:48:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:42 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.info Jul 10 06:48:42 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:42 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4" returned: 1 in 0.896s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:48:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:42 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce" returned: 0 in 0.900s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:42 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4 Jul 10 06:48:42 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:42 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce Jul 10 06:48:42 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:43 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.info" returned: 0 in 0.751s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.050s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-00c5da10-c8d5-460f-8823-7cbb23626630 tempest-SnapshotsActionsTest-180104588 None] Create snapshot completed successfully Jul 10 06:48:43 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4" returned: 0 in 0.794s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Lock "cinder-quobyte-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4" released by "delete_volume" :: held 2.700s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:43 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bad999f7-c069-4525-905a-617e8487f5ce" returned: 0 in 0.822s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-bad999f7-c069-4525-905a-617e8487f5ce" released by "delete_volume" :: held 1.826s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Created reservations ['84bfcd19-1129-412e-8f3b-10f3255ca81c', '40af3d84-bc4c-49ff-91b3-abb5c339078f', '9ea8c824-a8c7-4458-8379-9c6f63e5f3fc', 'c21ea7f9-fc30-4c02-a267-f1d4f16b0caf'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Created reservations ['7e8d82d6-3464-41c6-af7e-2ccda0163a37', '8b5827e3-26dd-463d-9e4b-889189cf056e', '472d9c95-9750-4d95-bded-505711cb22f9', '696f3472-8a2b-452a-b7d2-f5326276bbf8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:43 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:43 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:43 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:48:43 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] Creating offline snapshot a809df94-0969-44b4-83af-073e8fc4fd5f of volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:48:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e497d7d-3f62-4739-9df7-1c1f486e986a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:44 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:48:44 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:44 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.982s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:44 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Deleted volume successfully. Jul 10 06:48:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-31bf598a-f1c7-4d9a-b8ae-f1a77eaba93b tempest-VolumesGetTest-671559070 None] Lock "cinder-bad999f7-c069-4525-905a-617e8487f5ce-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:44 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.214s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:44 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Deleted volume successfully. Jul 10 06:48:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9ab3ca81-6177-438d-ae4a-89ae15be9904 tempest-VolumeImageDependencyTests-1176280218 None] Lock "cinder-e80ea9ca-5ab1-4d8a-ac08-aa755326c5b4-delete_volume" released by "delete_volume" :: held 4.284s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:45 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 1.317s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:48:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:45 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f 1G Jul 10 06:48:45 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:45 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:48:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (674e761a-7b5f-451e-9eed-d7f80e5442f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2f83df-cfc7-4189-bd5e-d4a930663ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2f83df-cfc7-4189-bd5e-d4a930663ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-751026237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce34e33-a5e2-4999-aa6f-ac7aae852d99,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:46Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d6b132-3fbe-4f13-a885-808f16c9bc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d6b132-3fbe-4f13-a885-808f16c9bc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7db3fa-dc43-4a13-8894-cbb374aa5c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:46 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:48:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7db3fa-dc43-4a13-8894-cbb374aa5c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5ce34e33-a5e2-4999-aa6f-ac7aae852d99', 'volume_name': 'volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69660dd1-67e4-4a2f-8906-ba99062fbe52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69660dd1-67e4-4a2f-8906-ba99062fbe52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf671ba6-302e-4e2c-8d83-222d177c3c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Volume 5ce34e33-a5e2-4999-aa6f-ac7aae852d99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 06:48:46 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Trying to clone 5ce34e33-a5e2-4999-aa6f-ac7aae852d99 from image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:48:46 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f 1G" returned: 0 in 1.470s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:46 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f Jul 10 06:48:46 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:47 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:48:47 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Image download 20.69 MB at 20.69 MB/s Jul 10 06:48:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4807c855-f55e-434a-8c7d-422af0a43dfc]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:47 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD Jul 10 06:48:47 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:47 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f" returned: 0 in 1.004s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:47 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f is being set with open permissions: ugo+rw Jul 10 06:48:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:47 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f Jul 10 06:48:47 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:48 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD" returned: 0 in 0.880s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:48 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Temporary image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 is fetched for user d8967b74b3364867ab7f12dcf9c92651. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:48:48 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[362cf7a6-98e7-4ff4-b3c3-a985afebd24e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:48 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD Jul 10 06:48:48 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:48 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f" returned: 0 in 0.963s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.975s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dd67beea-740f-4cf9-9cc9-9fe8752e0b63 tempest-SnapshotsActionsTest-180104588 None] Create snapshot completed successfully Jul 10 06:48:49 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD" returned: 0 in 0.979s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-751026237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce34e33-a5e2-4999-aa6f-ac7aae852d99,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:46Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Creating volume 5ce34e33-a5e2-4999-aa6f-ac7aae852d99 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:48:49 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:49 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 1073741824 Jul 10 06:48:49 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-a809df94-0969-44b4-83af-073e8fc4fd5f-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-a809df94-0969-44b4-83af-073e8fc4fd5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-quobyte-a809df94-0969-44b4-83af-073e8fc4fd5f" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-a809df94-0969-44b4-83af-073e8fc4fd5f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Deleting offline snapshot a809df94-0969-44b4-83af-073e8fc4fd5f of volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] snapshot_file for this snap is: volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4a5857-4856-47bc-a441-2f92ea5bf46b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:49 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f Jul 10 06:48:49 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:50 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 1073741824" returned: 0 in 1.309s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:50 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 Jul 10 06:48:50 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:50 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f" returned: 0 in 1.039s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:48:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4711ac8-1be4-47c1-8474-4f94722e9fb7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:50 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:48:50 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:51 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99" returned: 0 in 0.888s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] <== create_volume: return (2293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:48:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:51 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Attempting download of 3a4cb804-6b6d-41c8-ac4c-b431983d3649 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}])) to volume 5ce34e33-a5e2-4999-aa6f-ac7aae852d99. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:48:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf66117-3783-45b1-9b7c-77ffbcd061ac]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_fi3o4kza {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:51 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_fi3o4kza Jul 10 06:48:51 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:51 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 1.029s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:48:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:51 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f Jul 10 06:48:51 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:52 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_fi3o4kza" returned: 0 in 0.909s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_fi3o4kza {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:52 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_fi3o4kza Jul 10 06:48:52 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:52 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f" returned: 0 in 0.956s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:52 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f Jul 10 06:48:52 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:53 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_fi3o4kza" returned: 1 in 0.933s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_fi3o4kza' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:48:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd16c7b-2d43-446e-a2fb-d45da56627d1]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:53 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.a809df94-0969-44b4-83af-073e8fc4fd5f" returned: 0 in 0.790s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-a809df94-0969-44b4-83af-073e8fc4fd5f" released by "_delete_snapshot" :: held 3.976s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:53 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD Jul 10 06:48:53 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" released by "delete_snapshot" :: held 4.008s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:53 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Created reservations ['168358da-b760-4916-a370-ed4e09877e72', '8247d526-dd54-4d21-82cd-be134d347e30', 'e41745ab-e486-4e24-87cf-3e75882cc5ab', 'd27e8cf3-a53b-4ac6-9e32-9bd293a80a89'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Delete snapshot completed successfully. Jul 10 06:48:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dea22c03-11d1-4bf9-a458-1611c9638844 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-a809df94-0969-44b4-83af-073e8fc4fd5f-delete_snapshot" released by "delete_snapshot" :: held 4.227s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] Creating offline snapshot cfe90912-83bd-4fea-883e-130813e02ce2 of volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:48:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c807bb0-6761-49e3-bba9-b9360cc6c08b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:54 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD" returned: 0 in 0.935s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:54 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] 3a4cb804-6b6d-41c8-ac4c-b431983d3649 was qcow2, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:48:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:54 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 Jul 10 06:48:54 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:54 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:48:54 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:55 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 0.966s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:48:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:55 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 1G Jul 10 06:48:55 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:56 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 1G" returned: 0 in 1.520s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:56 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 Jul 10 06:48:56 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:57 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99" returned: 0 in 2.870s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:57 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_5ebbmhq0devstack@QuobyteHD, size 112.00 MB, duration 2.87 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:48:57 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Converted 112.00 MB image at 38.98 MB/s Jul 10 06:48:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:57 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 1G Jul 10 06:48:57 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:57 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2" returned: 0 in 1.109s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:57 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 is being set with open permissions: ugo+rw Jul 10 06:48:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:57 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 Jul 10 06:48:57 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:58 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 1G" returned: 0 in 1.261s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[021878af-1441-4da8-b0eb-f4857beceee9]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:58 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 Jul 10 06:48:58 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:58 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2" returned: 0 in 0.946s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.702s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bf5c5698-899b-4e72-8fff-d710d0275be5 tempest-SnapshotsActionsTest-180104588 None] Create snapshot completed successfully Jul 10 06:48:59 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99" returned: 0 in 0.924s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-cfe90912-83bd-4fea-883e-130813e02ce2-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-cfe90912-83bd-4fea-883e-130813e02ce2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:59 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 Jul 10 06:48:59 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-quobyte-cfe90912-83bd-4fea-883e-130813e02ce2" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-cfe90912-83bd-4fea-883e-130813e02ce2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Deleting offline snapshot cfe90912-83bd-4fea-883e-130813e02ce2 of volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] snapshot_file for this snap is: volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef39765-f987-4cd1-99ef-d42c6aaec9d2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:59 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 Jul 10 06:48:59 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:00 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99" returned: 1 in 0.888s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Downloaded image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}])) to volume 5ce34e33-a5e2-4999-aa6f-ac7aae852d99 successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Temporary image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 for user d8967b74b3364867ab7f12dcf9c92651 is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Marking volume 5ce34e33-a5e2-4999-aa6f-ac7aae852d99 as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Copying metadata from image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 to 5ce34e33-a5e2-4999-aa6f-ac7aae852d99. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Creating volume glance metadata for volume 5ce34e33-a5e2-4999-aa6f-ac7aae852d99 backed by image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf671ba6-302e-4e2c-8d83-222d177c3c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2764cb48-bc74-4374-bf44-c91235d3a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:00 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Volume volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 (5ce34e33-a5e2-4999-aa6f-ac7aae852d99): created successfully Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2764cb48-bc74-4374-bf44-c91235d3a71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (674e761a-7b5f-451e-9eed-d7f80e5442f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f7ab8a3c-aec5-42e5-a7c8-1bfdc7f85c16 tempest-VolumesGetTest-671559070 None] Created volume successfully. Jul 10 06:49:00 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2" returned: 0 in 1.067s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8affcd0-663f-4742-ba6b-181e06dcac00]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:00 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:49:00 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:01 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 0.893s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:01 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 Jul 10 06:49:01 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (29d35593-1323-46d9-8892-9bcc5c8ec192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcda6565-8064-4753-b9e6-b342a78332e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcda6565-8064-4753-b9e6-b342a78332e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-847252318',display_name='tempest-VolumesGetTest-Volume-1268478290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2484c35-9645-471a-bb57-3ca350ae5310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:02Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1fd0a2-4c55-4b2a-b672-24d2b9e956e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1fd0a2-4c55-4b2a-b672-24d2b9e956e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c088a628-6795-4577-a8c8-cdaa74414982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c088a628-6795-4577-a8c8-cdaa74414982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2484c35-9645-471a-bb57-3ca350ae5310', 'volume_name': 'volume-b2484c35-9645-471a-bb57-3ca350ae5310', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8627a2a-6c94-444c-ba17-feabc4304566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8627a2a-6c94-444c-ba17-feabc4304566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55faa18e-0f74-4b46-baba-7997a5f17472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Volume b2484c35-9645-471a-bb57-3ca350ae5310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2484c35-9645-471a-bb57-3ca350ae5310', 'volume_size': 1} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-847252318',display_name='tempest-VolumesGetTest-Volume-1268478290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2484c35-9645-471a-bb57-3ca350ae5310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91a7adc14c414244984996195f796a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:02Z,use_quota=True,user_id='d8967b74b3364867ab7f12dcf9c92651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Creating volume b2484c35-9645-471a-bb57-3ca350ae5310 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:02 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:49:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:02 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310 1073741824 Jul 10 06:49:02 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:03 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2" returned: 0 in 1.442s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:03 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2 Jul 10 06:49:03 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:04 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cfe90912-83bd-4fea-883e-130813e02ce2" returned: 0 in 0.900s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-cfe90912-83bd-4fea-883e-130813e02ce2" released by "_delete_snapshot" :: held 4.426s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:04 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" released by "delete_snapshot" :: held 4.465s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310 1073741824" returned: 0 in 1.365s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:04 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310 Jul 10 06:49:04 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:04 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Created reservations ['0f259dac-ebdf-4175-9e32-a35ab3c1e1d5', '27af2179-3ac3-4191-a64b-1ce36156ff59', '7bd978a3-4ef1-47ef-90a2-f95840a41161', 'a21c2c2f-44f4-4cf6-8566-0e66bd379c49'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Delete snapshot completed successfully. Jul 10 06:49:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8659f6fa-4132-4db9-8d50-3470b04d700c tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-cfe90912-83bd-4fea-883e-130813e02ce2-delete_snapshot" released by "delete_snapshot" :: held 4.715s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:05 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310" returned: 0 in 0.879s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] <== create_volume: return (2322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.326s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55faa18e-0f74-4b46-baba-7997a5f17472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2484c35-9645-471a-bb57-3ca350ae5310', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cebdf8-20bb-4afd-a2cc-4ca789b3ad9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Volume volume-b2484c35-9645-471a-bb57-3ca350ae5310 (b2484c35-9645-471a-bb57-3ca350ae5310): created successfully Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3cebdf8-20bb-4afd-a2cc-4ca789b3ad9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Flow 'volume_create_manager' (29d35593-1323-46d9-8892-9bcc5c8ec192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f6d05ea8-b327-4e93-b743-6235cd7c06ea tempest-VolumesGetTest-671559070 None] Created volume successfully. Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] Creating offline snapshot cf5de76d-16fe-4134-8023-6baf16783c8c of volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d8b536-f92e-4c94-8451-21a22dd47369]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:05 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:49:05 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-b2484c35-9645-471a-bb57-3ca350ae5310-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Lock "cinder-b2484c35-9645-471a-bb57-3ca350ae5310-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-quobyte-b2484c35-9645-471a-bb57-3ca350ae5310" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-b2484c35-9645-471a-bb57-3ca350ae5310" acquired by "delete_volume" :: waited 0.047s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[112d4050-16a1-4ebd-ba53-b6a66331353b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:06 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310 Jul 10 06:49:06 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:06 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 1.350s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:06 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c 1G Jul 10 06:49:06 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:07 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310" returned: 0 in 1.260s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:07 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310 Jul 10 06:49:07 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:08 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c 1G" returned: 0 in 1.225s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:08 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c Jul 10 06:49:08 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:08 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b2484c35-9645-471a-bb57-3ca350ae5310" returned: 0 in 0.865s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-b2484c35-9645-471a-bb57-3ca350ae5310" released by "delete_volume" :: held 2.210s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Created reservations ['c0dfb77b-78ba-4064-8407-818c4a16a549', '813d3c9c-e98d-484d-bae9-a80e947be0aa', '3b8bf974-0965-4a2e-84e4-bf3e9adb22de', '2b4e892b-2e37-4f70-a75c-33ba10f2c4e4'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:08 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:49:08 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:08 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c" returned: 0 in 0.945s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:08 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c is being set with open permissions: ugo+rw Jul 10 06:49:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:09 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c Jul 10 06:49:09 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:09 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-5ce34e33-a5e2-4999-aa6f-ac7aae852d99-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.950s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:09 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Deleted volume successfully. Jul 10 06:49:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Lock "cinder-5ce34e33-a5e2-4999-aa6f-ac7aae852d99-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a82cb064-9b66-43ac-9c5c-7977a88cc565 tempest-VolumesGetTest-671559070 None] Lock "cinder-b2484c35-9645-471a-bb57-3ca350ae5310-delete_volume" released by "delete_volume" :: held 3.604s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Acquiring lock "cinder-quobyte-5ce34e33-a5e2-4999-aa6f-ac7aae852d99" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-5ce34e33-a5e2-4999-aa6f-ac7aae852d99" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4628ad48-f20b-4cdd-917d-6cbf93757480]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:09 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 Jul 10 06:49:09 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:09 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c" returned: 0 in 0.938s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.614s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c1258355-bbbd-456e-8328-dbe0b2f6e435 tempest-SnapshotsActionsTest-180104588 None] Create snapshot completed successfully Jul 10 06:49:10 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99" returned: 0 in 0.852s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:10 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 Jul 10 06:49:10 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-cf5de76d-16fe-4134-8023-6baf16783c8c-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-cf5de76d-16fe-4134-8023-6baf16783c8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-quobyte-cf5de76d-16fe-4134-8023-6baf16783c8c" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-cf5de76d-16fe-4134-8023-6baf16783c8c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Deleting offline snapshot cf5de76d-16fe-4134-8023-6baf16783c8c of volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] snapshot_file for this snap is: volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebc2f8f-a69e-4cb1-8269-b268e61a1b69]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:10 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c Jul 10 06:49:10 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:11 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99" returned: 1 in 0.803s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:11 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99 Jul 10 06:49:11 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:11 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:49:11 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:11 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c" returned: 0 in 0.885s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd26b821-ef20-4d72-9711-e629990922e7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:11 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:49:11 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:12 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5ce34e33-a5e2-4999-aa6f-ac7aae852d99" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Lock "cinder-quobyte-5ce34e33-a5e2-4999-aa6f-ac7aae852d99" released by "delete_volume" :: held 2.482s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Created reservations ['5f62be3b-e1bf-4d78-86ab-b94232b76b6a', '5ad821f4-94b2-4c31-ab04-978b281ea7cd', '12fc5e72-3657-4ede-93fa-1d1b6676765f', '47dc1f4e-4c8a-4a9e-938e-839e504211ab'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:12 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:49:12 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:12 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.023s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:49:12 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 0.906s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:12 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c Jul 10 06:49:12 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:13 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.831s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:13 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Deleted volume successfully. Jul 10 06:49:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1468ae2-dc22-4737-8671-0fdadd0bdef4 tempest-VolumesGetTest-671559070 None] Lock "cinder-5ce34e33-a5e2-4999-aa6f-ac7aae852d99-delete_volume" released by "delete_volume" :: held 3.616s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:13 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c" returned: 0 in 0.975s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:13 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c Jul 10 06:49:13 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:14 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.cf5de76d-16fe-4134-8023-6baf16783c8c" returned: 0 in 0.788s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-cf5de76d-16fe-4134-8023-6baf16783c8c" released by "_delete_snapshot" :: held 3.658s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" released by "delete_snapshot" :: held 3.690s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:14 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Created reservations ['94e65997-6f0d-4927-8bab-4795144d64a6', 'ff87682e-26f3-47ba-aebb-df63210d696f', 'bba72899-55c7-4ef2-8c4e-6c55f2426e0c', '9481b0fe-b654-4da5-9084-b27bd652de7f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Delete snapshot completed successfully. Jul 10 06:49:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-962fb019-fc56-4e5a-986f-8a35cf440b49 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-cf5de76d-16fe-4134-8023-6baf16783c8c-delete_snapshot" released by "delete_snapshot" :: held 3.888s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] Creating offline snapshot 8c638858-2981-481c-b34e-989d8af5b1b9 of volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:49:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[18326d02-115e-4cac-b90a-f863011296c6]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:15 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:49:15 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:16 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 0.926s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:16 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 1G Jul 10 06:49:16 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Flow 'volume_create_manager' (aa7ace48-4bd1-4b76-ad52-e58bba9526be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc219f0-f9c7-44a7-9f44-ae7c8e6841dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc219f0-f9c7-44a7-9f44-ae7c8e6841dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1211877200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da62652-d85f-4ae4-9e45-386c4eee5a30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='395b8e4d204a4684b46895c00e7b9182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:16Z,use_quota=True,user_id='620bb62ad4a04629a97d58c5346952cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ab731c-dea7-4fdc-99b7-b64bdb7ef738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ab731c-dea7-4fdc-99b7-b64bdb7ef738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0d4a41-e4d9-403b-9259-a2b2030ca4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0d4a41-e4d9-403b-9259-a2b2030ca4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da62652-d85f-4ae4-9e45-386c4eee5a30', 'volume_name': 'volume-7da62652-d85f-4ae4-9e45-386c4eee5a30', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267b6bf7-0fd6-4a85-bba2-05a3df9ecea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267b6bf7-0fd6-4a85-bba2-05a3df9ecea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8df954-1b71-4393-abee-cb278b14c4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Volume 7da62652-d85f-4ae4-9e45-386c4eee5a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da62652-d85f-4ae4-9e45-386c4eee5a30', 'volume_size': 1} Jul 10 06:49:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:17 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 1G" returned: 0 in 0.877s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:17 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 Jul 10 06:49:17 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:18 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9" returned: 0 in 0.727s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:18 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 is being set with open permissions: ugo+rw Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:18 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 Jul 10 06:49:18 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:18 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9" returned: 0 in 0.620s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.260s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.134s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1211877200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da62652-d85f-4ae4-9e45-386c4eee5a30,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='395b8e4d204a4684b46895c00e7b9182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:16Z,use_quota=True,user_id='620bb62ad4a04629a97d58c5346952cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Creating volume 7da62652-d85f-4ae4-9e45-386c4eee5a30 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:18 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:49:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:18 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30 1073741824 Jul 10 06:49:18 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7b6aa0be-19bf-4404-8f02-759c1b3998ba tempest-SnapshotsActionsTest-180104588 None] Create snapshot completed successfully Jul 10 06:49:19 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30 1073741824" returned: 0 in 0.847s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:19 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30 Jul 10 06:49:19 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-8c638858-2981-481c-b34e-989d8af5b1b9-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-8c638858-2981-481c-b34e-989d8af5b1b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Acquiring lock "cinder-quobyte-8c638858-2981-481c-b34e-989d8af5b1b9" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-8c638858-2981-481c-b34e-989d8af5b1b9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Deleting offline snapshot 8c638858-2981-481c-b34e-989d8af5b1b9 of volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] snapshot_file for this snap is: volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f165d7a6-36dc-415a-8e4a-5e44e59be9d7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:19 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 Jul 10 06:49:19 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:20 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30" returned: 0 in 0.628s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:49:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8df954-1b71-4393-abee-cb278b14c4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da62652-d85f-4ae4-9e45-386c4eee5a30', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfc8000-5d32-41db-88d6-7e898ab0a9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:20 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Volume volume-7da62652-d85f-4ae4-9e45-386c4eee5a30 (7da62652-d85f-4ae4-9e45-386c4eee5a30): created successfully Jul 10 06:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfc8000-5d32-41db-88d6-7e898ab0a9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Flow 'volume_create_manager' (aa7ace48-4bd1-4b76-ad52-e58bba9526be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2bd74828-f835-4452-964c-bc84ba924e23 tempest-VolumesListTestJSON-1520173762 None] Created volume successfully. Jul 10 06:49:20 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9" returned: 0 in 0.802s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e806e69-6e08-41da-b396-96b3dc5c603c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:20 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:49:20 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Flow 'volume_create_manager' (e3c5b29c-8853-44b3-a20a-ce5a3ebda4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3489b6-3bfd-427a-8b58-2cc1f5782cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3489b6-3bfd-427a-8b58-2cc1f5782cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1852465412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7cde52d-ee25-4357-a68f-ff3338bb5223,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='395b8e4d204a4684b46895c00e7b9182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:21Z,use_quota=True,user_id='620bb62ad4a04629a97d58c5346952cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23630e83-9764-4c64-81ea-c8ad1dc66df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23630e83-9764-4c64-81ea-c8ad1dc66df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c9b193-6103-44e9-85f4-1e4e325f858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c9b193-6103-44e9-85f4-1e4e325f858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7cde52d-ee25-4357-a68f-ff3338bb5223', 'volume_name': 'volume-a7cde52d-ee25-4357-a68f-ff3338bb5223', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147404d8-367d-47d1-83d0-31c5b4d18c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147404d8-367d-47d1-83d0-31c5b4d18c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890ed89f-a591-42df-87ed-c43a035e0706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:21 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Volume a7cde52d-ee25-4357-a68f-ff3338bb5223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7cde52d-ee25-4357-a68f-ff3338bb5223', 'volume_size': 1} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1852465412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7cde52d-ee25-4357-a68f-ff3338bb5223,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='395b8e4d204a4684b46895c00e7b9182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:21Z,use_quota=True,user_id='620bb62ad4a04629a97d58c5346952cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Creating volume a7cde52d-ee25-4357-a68f-ff3338bb5223 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:21 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:21 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223 1073741824 Jul 10 06:49:21 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:21 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 0.823s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:21 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 Jul 10 06:49:21 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:22 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223 1073741824" returned: 0 in 0.918s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=92,cinder:INSERT=33,cinder:SELECT=82,cinder:DELETE=11 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:22 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223 Jul 10 06:49:22 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:22 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9" returned: 0 in 0.841s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:22 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9 Jul 10 06:49:22 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:22 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223" returned: 0 in 0.639s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890ed89f-a591-42df-87ed-c43a035e0706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7cde52d-ee25-4357-a68f-ff3338bb5223', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934268e1-e8aa-451c-9bef-74560e47644b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:22 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Volume volume-a7cde52d-ee25-4357-a68f-ff3338bb5223 (a7cde52d-ee25-4357-a68f-ff3338bb5223): created successfully Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934268e1-e8aa-451c-9bef-74560e47644b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Flow 'volume_create_manager' (e3c5b29c-8853-44b3-a20a-ce5a3ebda4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1e9468f9-d7cc-400d-b8b5-464803cc6f0a tempest-VolumesListTestJSON-1520173762 None] Created volume successfully. Jul 10 06:49:23 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.8c638858-2981-481c-b34e-989d8af5b1b9" returned: 0 in 0.671s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-8c638858-2981-481c-b34e-989d8af5b1b9" released by "_delete_snapshot" :: held 3.232s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" released by "delete_snapshot" :: held 3.261s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Created reservations ['161a54e6-2a15-4df0-90a7-91c425aeaf30', '9b2bf364-3a24-483f-b52f-803b8ce1beee', 'b9e38f07-80c2-40e2-a70a-bb8815bcb25e', 'd1d7d669-8c27-4a7a-a77f-37a86129b413'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Delete snapshot completed successfully. Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-352c14e5-b681-4a1b-b5f5-0fc7607d78b3 tempest-SnapshotsActionsTest-1609450349 None] Lock "cinder-8c638858-2981-481c-b34e-989d8af5b1b9-delete_snapshot" released by "delete_snapshot" :: held 3.413s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=94,cinder:UPDATE=111,cinder:DELETE=8,cinder:INSERT=36 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Flow 'volume_create_manager' (8ff3555d-ee07-4f6d-8b02-632aed498060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588c9f82-fc93-4c6d-822b-27e3694353ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588c9f82-fc93-4c6d-822b-27e3694353ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2095035187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8affa715-2deb-4dcb-b4cd-4281356d4830,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='395b8e4d204a4684b46895c00e7b9182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:24Z,use_quota=True,user_id='620bb62ad4a04629a97d58c5346952cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8705bded-b4f1-4f07-a334-5aef9ebaff87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8705bded-b4f1-4f07-a334-5aef9ebaff87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6523a4-7a0e-4f9a-85e2-4f52afd68211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6523a4-7a0e-4f9a-85e2-4f52afd68211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8affa715-2deb-4dcb-b4cd-4281356d4830', 'volume_name': 'volume-8affa715-2deb-4dcb-b4cd-4281356d4830', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302a3368-a090-447f-b48b-265266b19d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302a3368-a090-447f-b48b-265266b19d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e747116-b290-433d-a804-78ebc044c63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:23 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Volume 8affa715-2deb-4dcb-b4cd-4281356d4830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8affa715-2deb-4dcb-b4cd-4281356d4830', 'volume_size': 1} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2095035187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8affa715-2deb-4dcb-b4cd-4281356d4830,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='395b8e4d204a4684b46895c00e7b9182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:24Z,use_quota=True,user_id='620bb62ad4a04629a97d58c5346952cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Creating volume 8affa715-2deb-4dcb-b4cd-4281356d4830 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:23 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:49:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:23 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830 1073741824 Jul 10 06:49:23 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "cinder-e33ac3ee-92b4-4fdd-98f7-0425016937d4-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Lock "cinder-e33ac3ee-92b4-4fdd-98f7-0425016937d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "cinder-quobyte-e33ac3ee-92b4-4fdd-98f7-0425016937d4" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Lock "cinder-quobyte-e33ac3ee-92b4-4fdd-98f7-0425016937d4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Deleting offline snapshot e33ac3ee-92b4-4fdd-98f7-0425016937d4 of volume 3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] snapshot_file for this snap is: volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cff4be-6912-4c32-b356-0ef2eb0d1361]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:24 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:49:24 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:24 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830 1073741824" returned: 0 in 0.965s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:24 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830 Jul 10 06:49:24 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:25 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 0.899s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0096d4b-2792-4383-80b3-243a18f15c9f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:25 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a Jul 10 06:49:25 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:25 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830" returned: 0 in 0.747s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:49:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e747116-b290-433d-a804-78ebc044c63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8affa715-2deb-4dcb-b4cd-4281356d4830', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88ecbae-002a-404c-a81f-ee3182fe4bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Volume volume-8affa715-2deb-4dcb-b4cd-4281356d4830 (8affa715-2deb-4dcb-b4cd-4281356d4830): created successfully Jul 10 06:49:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88ecbae-002a-404c-a81f-ee3182fe4bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Flow 'volume_create_manager' (8ff3555d-ee07-4f6d-8b02-632aed498060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c1e2fbbd-506c-4d39-8f53-a0c36d96002d tempest-VolumesListTestJSON-1520173762 None] Created volume successfully. Jul 10 06:49:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a" returned: 0 in 0.806s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:26 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:26 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:49:26 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:27 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:27 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4 Jul 10 06:49:27 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:27 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a.e33ac3ee-92b4-4fdd-98f7-0425016937d4" returned: 0 in 0.707s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Lock "cinder-quobyte-e33ac3ee-92b4-4fdd-98f7-0425016937d4" released by "_delete_snapshot" :: held 3.273s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" released by "delete_snapshot" :: held 3.306s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:27 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Created reservations ['0851e8e7-26d0-4f09-aa2a-3cedc144a595', '95368ba5-3675-49a3-b44e-665297b6b05e', 'd828bff7-fd30-400d-9e06-b0a455ef413d', 'b765ab6d-86bb-4355-9d9c-7f8764b146a0'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Delete snapshot completed successfully. Jul 10 06:49:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c05e644f-c126-4e71-9ca2-d7ad4ce9a34f tempest-SnapshotsActionsTest-180104588 None] Lock "cinder-e33ac3ee-92b4-4fdd-98f7-0425016937d4-delete_snapshot" released by "delete_snapshot" :: held 3.483s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "cinder-8affa715-2deb-4dcb-b4cd-4281356d4830-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-8affa715-2deb-4dcb-b4cd-4281356d4830-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "cinder-quobyte-8affa715-2deb-4dcb-b4cd-4281356d4830" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-quobyte-8affa715-2deb-4dcb-b4cd-4281356d4830" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d768cfcf-e428-4bec-8f89-9e28ed6dd5e5]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "cinder-3966e30a-7929-4a6e-94ef-0e5a4db8147a-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:28 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830 Jul 10 06:49:28 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Lock "cinder-3966e30a-7929-4a6e-94ef-0e5a4db8147a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f44fbd4-fd83-48bb-9b3c-e0decb3ae38e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:29 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a Jul 10 06:49:29 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Flow 'volume_create_manager' (cef26e2b-4d61-4f05-9eca-d57e9b155dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c6128d-f5b9-4608-9c2c-2ab2a5effdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c6128d-f5b9-4608-9c2c-2ab2a5effdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-194161176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3c8920-ffdd-4297-a1dd-2da2285f79d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c95117f41a04618aa08429fb2391e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:29Z,use_quota=True,user_id='75dbbbd749844478a002d267682cabf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4828cb99-8cde-4c6d-87ca-d8e7f4851ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4828cb99-8cde-4c6d-87ca-d8e7f4851ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6abbba4-dc89-433b-9c4a-72180502d5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6abbba4-dc89-433b-9c4a-72180502d5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e3c8920-ffdd-4297-a1dd-2da2285f79d2', 'volume_name': 'volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdeb350-2d0a-418c-a6d5-2fb19e7f7fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdeb350-2d0a-418c-a6d5-2fb19e7f7fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430b10fc-8cd8-4ec7-91db-f84c0a5169f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Volume 3e3c8920-ffdd-4297-a1dd-2da2285f79d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2', 'volume_size': 1} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-194161176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3c8920-ffdd-4297-a1dd-2da2285f79d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c95117f41a04618aa08429fb2391e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:29Z,use_quota=True,user_id='75dbbbd749844478a002d267682cabf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Creating volume 3e3c8920-ffdd-4297-a1dd-2da2285f79d2 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:29 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:29 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830" returned: 0 in 0.838s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:29 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 1073741824 Jul 10 06:49:29 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:29 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830 Jul 10 06:49:29 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:29 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a" returned: 0 in 0.850s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:29 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a Jul 10 06:49:29 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:30 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8affa715-2deb-4dcb-b4cd-4281356d4830" returned: 0 in 0.763s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-quobyte-8affa715-2deb-4dcb-b4cd-4281356d4830" released by "delete_volume" :: held 1.649s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Created reservations ['3662b3fd-736c-4691-b87b-1b2e9f3e4e4f', '330fac10-4c23-4acd-b1da-c18eff6ab27b', '1c22d075-ea92-4f03-a1df-920612ae1f8d', 'b678620d-829d-401c-bf96-4debdc56bfc8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:30 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 1073741824" returned: 0 in 0.916s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:30 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 Jul 10 06:49:30 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:30 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:49:30 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:30 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3966e30a-7929-4a6e-94ef-0e5a4db8147a" returned: 0 in 0.750s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Lock "cinder-quobyte-3966e30a-7929-4a6e-94ef-0e5a4db8147a" released by "delete_volume" :: held 1.670s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Created reservations ['454a02e1-cba8-4627-bee8-c2aec8a476f7', 'c7853aec-da70-474b-8610-3185cc1eaf75', 'c182314d-1c96-4b60-b337-2dad971549e9', '044682ec-4098-4c55-9035-c1d112c6ce87'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:30 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:49:30 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "cinder-a7cde52d-ee25-4357-a68f-ff3338bb5223-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-a7cde52d-ee25-4357-a68f-ff3338bb5223-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "cinder-quobyte-a7cde52d-ee25-4357-a68f-ff3338bb5223" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-quobyte-a7cde52d-ee25-4357-a68f-ff3338bb5223" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[680b5407-22eb-4853-969e-0d2e4d274533]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:31 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.766s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:31 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2" returned: 0 in 0.815s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Deleted volume successfully. Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430b10fc-8cd8-4ec7-91db-f84c0a5169f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99958d8-5d3c-4175-90c4-69757c4f8bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b843925e-1f37-46b6-b3c6-43806e4874da tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-8affa715-2deb-4dcb-b4cd-4281356d4830-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:31 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Volume volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 (3e3c8920-ffdd-4297-a1dd-2da2285f79d2): created successfully Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99958d8-5d3c-4175-90c4-69757c4f8bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Flow 'volume_create_manager' (cef26e2b-4d61-4f05-9eca-d57e9b155dd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:31 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223 Jul 10 06:49:31 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-17c924ba-b879-40d7-a74b-85aa6808f4ad tempest-AttachVolumeTestJSON-1394904718 None] Created volume successfully. Jul 10 06:49:31 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.935s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Deleted volume successfully. Jul 10 06:49:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ec039d7-bdf3-4099-a7eb-56ef395bddf4 tempest-SnapshotsActionsTest-180104588 None] Lock "cinder-3966e30a-7929-4a6e-94ef-0e5a4db8147a-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:32 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223" returned: 0 in 0.945s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:32 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223 Jul 10 06:49:32 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:32 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7cde52d-ee25-4357-a68f-ff3338bb5223" returned: 0 in 0.695s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-quobyte-a7cde52d-ee25-4357-a68f-ff3338bb5223" released by "delete_volume" :: held 1.704s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Created reservations ['9ffed789-de28-4350-89c1-ec828d742170', '69779bf1-4ed1-4b53-8a23-93eb568109ca', '281b98ab-2c57-4da6-85ad-38a3ef949c11', '59838804-1667-464e-a36e-158e7ead1cef'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:32 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:49:32 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "cinder-7da62652-d85f-4ae4-9e45-386c4eee5a30-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-7da62652-d85f-4ae4-9e45-386c4eee5a30-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "cinder-quobyte-7da62652-d85f-4ae4-9e45-386c4eee5a30" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-quobyte-7da62652-d85f-4ae4-9e45-386c4eee5a30" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c60d43-cd32-4cb7-8db4-7852b8db4a60]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:33 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30 Jul 10 06:49:33 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:33 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.702s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:33 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Deleted volume successfully. Jul 10 06:49:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-15944f60-7c9c-4863-84a1-f6e53f532eae tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-a7cde52d-ee25-4357-a68f-ff3338bb5223-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:34 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30" returned: 0 in 0.895s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:34 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30 Jul 10 06:49:34 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-fa3607b7-f580-4155-ba55-7ee6fc0c002a req-684404a8-0b5f-4a53-8ccb-d0796e79e815 tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-fa3607b7-f580-4155-ba55-7ee6fc0c002a req-684404a8-0b5f-4a53-8ccb-d0796e79e815 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44856af-a0b5-49b0-8065-67a407e76901]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-fa3607b7-f580-4155-ba55-7ee6fc0c002a req-684404a8-0b5f-4a53-8ccb-d0796e79e815 tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:34 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 Jul 10 06:49:34 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:35 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7da62652-d85f-4ae4-9e45-386c4eee5a30" returned: 0 in 0.697s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-quobyte-7da62652-d85f-4ae4-9e45-386c4eee5a30" released by "delete_volume" :: held 1.650s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Created reservations ['a91d0547-2388-4867-a29f-8369fffb12a1', '04100962-8d1f-461c-af6b-23daf4dd96c4', '08b92898-d4c4-40d3-89b2-ecd628ae739f', '8ed51642-cf73-483f-b2db-6b6953b91404'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:35 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:49:35 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:35 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-fa3607b7-f580-4155-ba55-7ee6fc0c002a req-684404a8-0b5f-4a53-8ccb-d0796e79e815 tempest-AttachVolumeTestJSON-1394904718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2" returned: 0 in 0.953s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-fa3607b7-f580-4155-ba55-7ee6fc0c002a req-684404a8-0b5f-4a53-8ccb-d0796e79e815 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.974s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-fa3607b7-f580-4155-ba55-7ee6fc0c002a req-684404a8-0b5f-4a53-8ccb-d0796e79e815 tempest-AttachVolumeTestJSON-1394904718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79215c5a-831c-4789-92e0-694c5c1e731a', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:49:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-fa3607b7-f580-4155-ba55-7ee6fc0c002a req-684404a8-0b5f-4a53-8ccb-d0796e79e815 tempest-AttachVolumeTestJSON-1394904718 None] attachment_update completed successfully. Jul 10 06:49:36 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.748s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:36 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Deleted volume successfully. Jul 10 06:49:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14da835b-0162-41ba-bbde-f051752db442 tempest-VolumesListTestJSON-1520173762 None] Lock "cinder-7da62652-d85f-4ae4-9e45-386c4eee5a30-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Flow 'volume_create_manager' (dc1a628f-2687-4b1d-b09c-664f5e078095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9485bcf6-5060-4946-a251-611eb01f0550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9485bcf6-5060-4946-a251-611eb01f0550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-280883491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532d711f-f6b2-41f7-b437-fda71a810bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d83252455e84b9c84f529294751a82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:37Z,use_quota=True,user_id='e8c53f42b6d340c48fc69585ebd602de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dae1512-e741-46c3-ad5f-494095fda31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dae1512-e741-46c3-ad5f-494095fda31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684a1a26-8158-4f37-ac66-a0718d52df7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684a1a26-8158-4f37-ac66-a0718d52df7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532d711f-f6b2-41f7-b437-fda71a810bdd', 'volume_name': 'volume-532d711f-f6b2-41f7-b437-fda71a810bdd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f670188a-93ad-4f0b-9d45-a04e25927719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f670188a-93ad-4f0b-9d45-a04e25927719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd945d6f-bd44-4ff8-95ba-e848322706ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:37 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Volume 532d711f-f6b2-41f7-b437-fda71a810bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532d711f-f6b2-41f7-b437-fda71a810bdd', 'volume_size': 1} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-280883491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532d711f-f6b2-41f7-b437-fda71a810bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d83252455e84b9c84f529294751a82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:37Z,use_quota=True,user_id='e8c53f42b6d340c48fc69585ebd602de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Creating volume 532d711f-f6b2-41f7-b437-fda71a810bdd {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:37 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:49:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:37 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd 1073741824 Jul 10 06:49:37 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:38 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd 1073741824" returned: 0 in 0.876s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:38 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd Jul 10 06:49:38 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Flow 'volume_create_manager' (c6c24d0a-1490-4c8f-a379-2b65326ebb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1369e473-d215-4c9b-a66f-f33501254293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1369e473-d215-4c9b-a66f-f33501254293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1089133675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a199e40d-ac5b-4e8e-b463-9806ab9afeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b62a16ccc074a1abbea8743b8090a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:39Z,use_quota=True,user_id='8e4c5e47348f4b0195d69dc41b2e5a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ea243d-e2ed-4ae1-882b-129ede51e1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ea243d-e2ed-4ae1-882b-129ede51e1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1359395-7f5a-4705-b457-2f12edd176df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1359395-7f5a-4705-b457-2f12edd176df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a199e40d-ac5b-4e8e-b463-9806ab9afeed', 'volume_name': 'volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d777aed-59c3-4aaa-8590-ed75c0ad27d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d777aed-59c3-4aaa-8590-ed75c0ad27d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad152f9-070f-4dc5-8145-41071903060a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:39 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Volume a199e40d-ac5b-4e8e-b463-9806ab9afeed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed', 'volume_size': 1} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:39 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd" returned: 0 in 0.655s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.113s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1089133675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a199e40d-ac5b-4e8e-b463-9806ab9afeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b62a16ccc074a1abbea8743b8090a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:39Z,use_quota=True,user_id='8e4c5e47348f4b0195d69dc41b2e5a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Creating volume a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:39 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:39 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed 1073741824 Jul 10 06:49:39 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd945d6f-bd44-4ff8-95ba-e848322706ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532d711f-f6b2-41f7-b437-fda71a810bdd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f6b768-4de7-485d-9b3e-66e2a701d62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:39 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Volume volume-532d711f-f6b2-41f7-b437-fda71a810bdd (532d711f-f6b2-41f7-b437-fda71a810bdd): created successfully Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f6b768-4de7-485d-9b3e-66e2a701d62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Flow 'volume_create_manager' (dc1a628f-2687-4b1d-b09c-664f5e078095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1ed39440-84b2-4974-981d-3417452f2ba8 tempest-VolumesServicesTestJSON-485721967 None] Created volume successfully. Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Acquiring lock "cinder-532d711f-f6b2-41f7-b437-fda71a810bdd-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Lock "cinder-532d711f-f6b2-41f7-b437-fda71a810bdd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Acquiring lock "cinder-quobyte-532d711f-f6b2-41f7-b437-fda71a810bdd" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Lock "cinder-quobyte-532d711f-f6b2-41f7-b437-fda71a810bdd" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae3e53-69ff-4b1a-883c-52148a9c9ffc]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:39 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd Jul 10 06:49:39 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:40 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed 1073741824" returned: 0 in 0.917s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:40 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed Jul 10 06:49:40 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:40 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd" returned: 0 in 0.882s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:40 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd Jul 10 06:49:40 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:40 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed" returned: 0 in 0.730s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:49:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad152f9-070f-4dc5-8145-41071903060a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a58296a-2a93-44a1-ab88-522de99241e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Volume volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed (a199e40d-ac5b-4e8e-b463-9806ab9afeed): created successfully Jul 10 06:49:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a58296a-2a93-44a1-ab88-522de99241e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Flow 'volume_create_manager' (c6c24d0a-1490-4c8f-a379-2b65326ebb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f73933aa-86fd-476b-86ba-d8867c131b8c tempest-VolumesSnapshotListTestJSON-1522631957 None] Created volume successfully. Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] Creating offline snapshot 11a17fba-036f-432d-a478-5bbbc9300d89 of volume a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2626fe-2fca-45b7-9f2c-57880c272f6c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:41 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed Jul 10 06:49:41 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Flow 'volume_create_manager' (f196b8f3-cf67-439a-8a2d-07d730485401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d89d18-e649-4cc0-9a76-f9884779587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d89d18-e649-4cc0-9a76-f9884779587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1857367616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d543115-dd46-48b5-8515-97b50006977f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c95117f41a04618aa08429fb2391e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:41Z,use_quota=True,user_id='75dbbbd749844478a002d267682cabf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47106c19-e36d-447c-bb51-a3cd1059906d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47106c19-e36d-447c-bb51-a3cd1059906d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db16c47-57fe-4412-b98f-5ade05a5a049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db16c47-57fe-4412-b98f-5ade05a5a049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d543115-dd46-48b5-8515-97b50006977f', 'volume_name': 'volume-2d543115-dd46-48b5-8515-97b50006977f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdf96c9-ab47-4667-8533-dd0cc2b41f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdf96c9-ab47-4667-8533-dd0cc2b41f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c0a42f-8632-4615-b80f-f4a4b596c265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:41 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Volume 2d543115-dd46-48b5-8515-97b50006977f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d543115-dd46-48b5-8515-97b50006977f', 'volume_size': 1} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:41 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-532d711f-f6b2-41f7-b437-fda71a810bdd" returned: 0 in 0.839s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Lock "cinder-quobyte-532d711f-f6b2-41f7-b437-fda71a810bdd" released by "delete_volume" :: held 1.763s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Created reservations ['b727baa8-bd23-4986-bbb9-93f0ef0ba76f', '5091e530-1e0b-4416-9694-5a02865beb48', 'c198481c-3417-4344-b031-0e22dafdd687', 'e42c6613-8d18-4e27-a795-57a3b2cc5b83'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:41 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:49:41 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:42 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed" returned: 0 in 0.952s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:42 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 1G Jul 10 06:49:42 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:42 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.764s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:42 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Deleted volume successfully. Jul 10 06:49:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08481e6a-72af-47ef-9627-c9de490e4270 tempest-VolumesServicesTestJSON-485721967 None] Lock "cinder-532d711f-f6b2-41f7-b437-fda71a810bdd-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:43 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 1G" returned: 0 in 0.869s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:43 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 Jul 10 06:49:43 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:43 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89" returned: 0 in 0.756s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:43 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 is being set with open permissions: ugo+rw Jul 10 06:49:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:43 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 Jul 10 06:49:43 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:44 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89" returned: 0 in 0.719s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:44 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.info Jul 10 06:49:44 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:45 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.info" returned: 0 in 0.687s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:45 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.info is being set with open permissions: ugo+rw Jul 10 06:49:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:45 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.info Jul 10 06:49:45 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:46 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.info" returned: 0 in 0.762s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.879s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.594s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1857367616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d543115-dd46-48b5-8515-97b50006977f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c95117f41a04618aa08429fb2391e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:41Z,use_quota=True,user_id='75dbbbd749844478a002d267682cabf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Creating volume 2d543115-dd46-48b5-8515-97b50006977f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:46 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:46 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f 1073741824 Jul 10 06:49:46 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-15ed4a4a-33f3-440f-9612-ab6398ceca27 tempest-VolumesSnapshotListTestJSON-1522631957 None] Create snapshot completed successfully Jul 10 06:49:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:47 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f 1073741824" returned: 0 in 0.898s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:47 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f Jul 10 06:49:47 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:47 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f" returned: 0 in 0.685s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.076s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c0a42f-8632-4615-b80f-f4a4b596c265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d543115-dd46-48b5-8515-97b50006977f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd4e39e-1c45-44ca-aac1-2066aa655d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] Creating offline snapshot fa4808bf-a54b-45cc-ac66-31c00a391650 of volume a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:49:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Volume volume-2d543115-dd46-48b5-8515-97b50006977f (2d543115-dd46-48b5-8515-97b50006977f): created successfully Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbd4e39e-1c45-44ca-aac1-2066aa655d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Flow 'volume_create_manager' (f196b8f3-cf67-439a-8a2d-07d730485401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea6f134-a06f-4e0a-b34a-481cef9af7ad]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-66250150-3167-4aaf-9c4e-608e0a0bc642 tempest-AttachVolumeTestJSON-1394904718 None] Created volume successfully. Jul 10 06:49:48 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 Jul 10 06:49:48 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Flow 'volume_create_manager' (c37bba98-e754-43ea-83a1-adb0b667ae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf755f9-8db0-4e8e-87fc-56650b27d26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf755f9-8db0-4e8e-87fc-56650b27d26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-981974776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09030f42-e0bd-4611-ac9d-00d02fc88fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e424ec4fa54a68a7a3ab319c3c95dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:48Z,use_quota=True,user_id='29663e9ab58b41e0bf6fb6f1f8a42db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27a1268c-cbec-4088-8c43-20364318df2e),volume_type_id=27a1268c-cbec-4088-8c43-20364318df2e)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501897d5-ed6b-4c03-8088-a603492503ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501897d5-ed6b-4c03-8088-a603492503ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585c7c29-226b-472a-9217-a52eda72d42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585c7c29-226b-472a-9217-a52eda72d42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09030f42-e0bd-4611-ac9d-00d02fc88fc0', 'volume_name': 'volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01859a62-aec0-42bc-b0ed-d2755ff00e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01859a62-aec0-42bc-b0ed-d2755ff00e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4645e571-000b-414d-ac53-9cd73bf203d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Volume 09030f42-e0bd-4611-ac9d-00d02fc88fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0', 'volume_size': 1} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:48 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89" returned: 0 in 0.830s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:48 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 1G Jul 10 06:49:48 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:49 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 1G" returned: 0 in 0.870s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:49 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 Jul 10 06:49:49 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:50 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650" returned: 0 in 0.666s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:50 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 is being set with open permissions: ugo+rw Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:50 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 Jul 10 06:49:50 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:50 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650" returned: 0 in 0.675s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.181s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.533s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-981974776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09030f42-e0bd-4611-ac9d-00d02fc88fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9e424ec4fa54a68a7a3ab319c3c95dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:48Z,use_quota=True,user_id='29663e9ab58b41e0bf6fb6f1f8a42db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27a1268c-cbec-4088-8c43-20364318df2e),volume_type_id=27a1268c-cbec-4088-8c43-20364318df2e)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Creating volume 09030f42-e0bd-4611-ac9d-00d02fc88fc0 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:50 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:49:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:51 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0 1073741824 Jul 10 06:49:51 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cb63f7aa-f91e-49fc-b181-7b647c737205 tempest-VolumesSnapshotListTestJSON-1522631957 None] Create snapshot completed successfully Jul 10 06:49:51 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0 1073741824" returned: 0 in 0.905s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:51 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0 Jul 10 06:49:51 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-174eedbd-2b64-40c3-a1ab-a65cfb3ec179 req-544338a7-649d-467c-9cb3-901ab92ba55c tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:52 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0" returned: 0 in 0.703s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.493s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] Creating offline snapshot bd4e4a63-f9bd-4bee-941c-58033cea6bc3 of volume a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4645e571-000b-414d-ac53-9cd73bf203d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe602e6-9652-40da-9d75-a8d3a18c3535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e6eca4-c1ca-4956-a1bd-af92b26967f4]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:52 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Volume volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0 (09030f42-e0bd-4611-ac9d-00d02fc88fc0): created successfully Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efe602e6-9652-40da-9d75-a8d3a18c3535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Flow 'volume_create_manager' (c37bba98-e754-43ea-83a1-adb0b667ae49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-139461b9-99b3-4eb9-9188-38fdd10245d0 tempest-VolumeTypesAccessTest-1351120894 None] Created volume successfully. Jul 10 06:49:52 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 Jul 10 06:49:52 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:53 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650" returned: 0 in 0.761s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:53 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 1G Jul 10 06:49:53 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Acquiring lock "cinder-09030f42-e0bd-4611-ac9d-00d02fc88fc0-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Lock "cinder-09030f42-e0bd-4611-ac9d-00d02fc88fc0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Acquiring lock "cinder-quobyte-09030f42-e0bd-4611-ac9d-00d02fc88fc0" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Lock "cinder-quobyte-09030f42-e0bd-4611-ac9d-00d02fc88fc0" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbd5d11-783a-43d2-86c2-141dce9dfa3f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:53 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0 Jul 10 06:49:53 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:54 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 1G" returned: 0 in 0.936s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:54 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 Jul 10 06:49:54 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:54 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0" returned: 0 in 0.838s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:54 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0 Jul 10 06:49:54 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:55 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3" returned: 0 in 0.756s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:55 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 is being set with open permissions: ugo+rw Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:55 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 Jul 10 06:49:55 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:55 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-09030f42-e0bd-4611-ac9d-00d02fc88fc0" returned: 0 in 0.687s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Lock "cinder-quobyte-09030f42-e0bd-4611-ac9d-00d02fc88fc0" released by "delete_volume" :: held 1.580s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:55 devstack cinder-volume[86966]: WARNING cinder.quota [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1586461000 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1586461000, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:49:55 devstack cinder-volume[86966]: WARNING cinder.quota [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1586461000 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1586461000, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Created reservations ['ef57a3ba-36d0-4597-a32f-0d80b3801f08', '0781bc97-4649-4912-b6f4-48b6b77ac6dd', 'ebe605f9-ddd1-4ef7-821f-86885e16bd11', '291917bb-5795-48df-9a0e-9bd283e94894'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:55 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:49:55 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:55 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3" returned: 0 in 0.719s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.280s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-174eedbd-2b64-40c3-a1ab-a65cfb3ec179 req-544338a7-649d-467c-9cb3-901ab92ba55c tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.752s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c55d4b0-4bcd-48df-bebb-ca68fac10d49]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-174eedbd-2b64-40c3-a1ab-a65cfb3ec179 req-544338a7-649d-467c-9cb3-901ab92ba55c tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3fcfec5a-3240-41af-86b4-d29c1149517d tempest-VolumesSnapshotListTestJSON-1522631957 None] Create snapshot completed successfully Jul 10 06:49:56 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f Jul 10 06:49:56 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:56 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.729s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:56 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Deleted volume successfully. Jul 10 06:49:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d9ff81ec-f949-4081-a504-ba2d1f0c828c tempest-VolumeTypesAccessTest-1351120894 None] Lock "cinder-09030f42-e0bd-4611-ac9d-00d02fc88fc0-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:56 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-174eedbd-2b64-40c3-a1ab-a65cfb3ec179 req-544338a7-649d-467c-9cb3-901ab92ba55c tempest-AttachVolumeTestJSON-1394904718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f" returned: 0 in 0.882s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-174eedbd-2b64-40c3-a1ab-a65cfb3ec179 req-544338a7-649d-467c-9cb3-901ab92ba55c tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.919s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-174eedbd-2b64-40c3-a1ab-a65cfb3ec179 req-544338a7-649d-467c-9cb3-901ab92ba55c tempest-AttachVolumeTestJSON-1394904718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-2d543115-dd46-48b5-8515-97b50006977f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f9e7b3e-1cfb-474c-8c26-580f82262f56', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:49:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-174eedbd-2b64-40c3-a1ab-a65cfb3ec179 req-544338a7-649d-467c-9cb3-901ab92ba55c tempest-AttachVolumeTestJSON-1394904718 None] attachment_update completed successfully. Jul 10 06:49:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "cinder-bd4e4a63-f9bd-4bee-941c-58033cea6bc3-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-bd4e4a63-f9bd-4bee-941c-58033cea6bc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "cinder-quobyte-bd4e4a63-f9bd-4bee-941c-58033cea6bc3" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-bd4e4a63-f9bd-4bee-941c-58033cea6bc3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Deleting offline snapshot bd4e4a63-f9bd-4bee-941c-58033cea6bc3 of volume a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:49:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] snapshot_file for this snap is: volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:49:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3040f8ca-1b27-4a18-ac35-d4b8dad103ff]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:57 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 Jul 10 06:49:57 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:58 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3" returned: 0 in 0.942s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eb4252-9954-4c80-8746-f3147b847173]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:58 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 Jul 10 06:49:58 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:59 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650" returned: 0 in 0.930s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:59 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 Jul 10 06:49:59 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:00 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3" returned: 0 in 0.915s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:00 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3 Jul 10 06:50:00 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:01 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.bd4e4a63-f9bd-4bee-941c-58033cea6bc3" returned: 0 in 0.709s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-bd4e4a63-f9bd-4bee-941c-58033cea6bc3" released by "_delete_snapshot" :: held 3.611s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" released by "delete_snapshot" :: held 3.641s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Created reservations ['6651d667-5988-4857-a48d-4e2d2dc79776', 'fdec66e4-f8de-4651-92d4-d82f26fe84bc', '49e4d821-f04d-4fc1-9784-ebf3745919ba', '45b1b53c-4433-4238-be34-8bcdaff98216'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Delete snapshot completed successfully. Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c1bc3974-fb97-4d74-a015-dfe719b31208 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-bd4e4a63-f9bd-4bee-941c-58033cea6bc3-delete_snapshot" released by "delete_snapshot" :: held 3.817s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "cinder-fa4808bf-a54b-45cc-ac66-31c00a391650-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-fa4808bf-a54b-45cc-ac66-31c00a391650-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "cinder-quobyte-fa4808bf-a54b-45cc-ac66-31c00a391650" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-fa4808bf-a54b-45cc-ac66-31c00a391650" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Deleting offline snapshot fa4808bf-a54b-45cc-ac66-31c00a391650 of volume a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] snapshot_file for this snap is: volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb05ee3b-8220-4037-8630-afec9be8bd78]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:01 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 Jul 10 06:50:01 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:02 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650" returned: 0 in 0.883s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:50:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db8a91d-c67f-49b9-8c1a-134691c1b5d4]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:02 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 Jul 10 06:50:02 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:03 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89" returned: 0 in 0.810s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:50:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:03 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 Jul 10 06:50:03 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-4761104d-4d67-48a2-bf52-5942deb17a4d req-25c37aa1-f73d-4bd4-96e6-843be6290da3 tempest-AttachVolumeTestJSON-1394904718 None] Terminate volume connection completed successfully. Jul 10 06:50:03 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4761104d-4d67-48a2-bf52-5942deb17a4d req-25c37aa1-f73d-4bd4-96e6-843be6290da3 tempest-AttachVolumeTestJSON-1394904718 None] Deleting attachment 79215c5a-831c-4789-92e0-694c5c1e731a. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:50:04 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650" returned: 0 in 0.852s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:04 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650 Jul 10 06:50:04 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:05 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.fa4808bf-a54b-45cc-ac66-31c00a391650" returned: 0 in 0.737s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-fa4808bf-a54b-45cc-ac66-31c00a391650" released by "_delete_snapshot" :: held 3.417s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" released by "delete_snapshot" :: held 3.453s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Created reservations ['57f9ff6d-fe6f-4372-9bdf-ccbcf06b9f7f', '03fd05af-0425-425d-84c7-424e632a1fbd', '89283c14-9bd0-47af-9090-e3e8c2838493', '7ba860d4-8c4e-4660-b859-356444435234'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Delete snapshot completed successfully. Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b9d55b9-42d7-4651-bc6f-cb8070144870 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-fa4808bf-a54b-45cc-ac66-31c00a391650-delete_snapshot" released by "delete_snapshot" :: held 3.656s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "cinder-11a17fba-036f-432d-a478-5bbbc9300d89-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-11a17fba-036f-432d-a478-5bbbc9300d89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "cinder-quobyte-11a17fba-036f-432d-a478-5bbbc9300d89" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-11a17fba-036f-432d-a478-5bbbc9300d89" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Deleting offline snapshot 11a17fba-036f-432d-a478-5bbbc9300d89 of volume a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:50:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] snapshot_file for this snap is: volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:50:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a5570d-002b-459c-b570-7789936d45e9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:06 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 Jul 10 06:50:06 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-8001cd31-5c2b-4da6-ac08-52436cf88651 req-974904e9-d768-4a29-8b6f-2e8b946e6f60 tempest-AttachVolumeTestJSON-1394904718 None] Terminate volume connection completed successfully. Jul 10 06:50:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-8001cd31-5c2b-4da6-ac08-52436cf88651 req-974904e9-d768-4a29-8b6f-2e8b946e6f60 tempest-AttachVolumeTestJSON-1394904718 None] Deleting attachment 7f9e7b3e-1cfb-474c-8c26-580f82262f56. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:50:07 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89" returned: 0 in 1.002s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:50:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac69fd67-227f-4547-b457-05e2a6f6264c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:07 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed Jul 10 06:50:07 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:07 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed" returned: 0 in 0.864s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:07 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 Jul 10 06:50:07 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:08 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89" returned: 0 in 0.860s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:08 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89 Jul 10 06:50:08 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:09 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed.11a17fba-036f-432d-a478-5bbbc9300d89" returned: 0 in 0.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-11a17fba-036f-432d-a478-5bbbc9300d89" released by "_delete_snapshot" :: held 3.632s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" released by "delete_snapshot" :: held 3.663s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:09 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Created reservations ['a8096649-0f3c-4016-a143-51bdc89cec8f', '8d84aa41-2213-4e6d-b30c-32ba1084f688', 'e22b05b2-0148-48c5-8598-a56f643fcece', '775455a3-a564-4385-9433-658c9015375a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Delete snapshot completed successfully. Jul 10 06:50:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5cc72f6e-b3f2-40ef-a97e-cbdfd090e903 tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-11a17fba-036f-432d-a478-5bbbc9300d89-delete_snapshot" released by "delete_snapshot" :: held 3.804s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "cinder-a199e40d-ac5b-4e8e-b463-9806ab9afeed-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-a199e40d-ac5b-4e8e-b463-9806ab9afeed-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a362495c-db20-4c96-aa47-0dcb880de5b7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:10 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed Jul 10 06:50:10 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:11 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed" returned: 0 in 0.998s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:11 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed Jul 10 06:50:11 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:50:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:11 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:50:11 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:12 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a199e40d-ac5b-4e8e-b463-9806ab9afeed" returned: 0 in 0.843s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-quobyte-a199e40d-ac5b-4e8e-b463-9806ab9afeed" released by "delete_volume" :: held 1.926s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Created reservations ['f05acbcb-c7c7-4c38-93fc-4316ecf888a1', '7f90e6b0-39ee-45b2-804d-91c92852c19d', '107fa531-19ef-4aef-94cf-c9ea00335279', 'a4bc3391-a105-479a-ab49-5354d427d84a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:12 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:50:12 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:12 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.144s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:50:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:50:13 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.047s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:13 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Deleted volume successfully. Jul 10 06:50:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cac29a34-b4d6-47c6-8dae-13ffe2b35dfa tempest-VolumesSnapshotListTestJSON-1522631957 None] Lock "cinder-a199e40d-ac5b-4e8e-b463-9806ab9afeed-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Flow 'volume_create_manager' (0fcb2541-fe18-4b7f-956d-1d39387ea203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ad51ec-2dde-4687-a489-886cff711cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ad51ec-2dde-4687-a489-886cff711cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1401312031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cb6a62-b8f3-4633-af77-58b5f69360aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df52c8f3b9124599b0735b5c12a7fe06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:18Z,use_quota=True,user_id='11d2d7e8cc80402e9ec8a187f31fc097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7548a5-a742-45cb-8037-d47172cd1391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7548a5-a742-45cb-8037-d47172cd1391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fdc1ee-eb20-447b-84f5-5e0f6eaeca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60fdc1ee-eb20-447b-84f5-5e0f6eaeca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9cb6a62-b8f3-4633-af77-58b5f69360aa', 'volume_name': 'volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b9ff39-02a2-404f-b876-6766082b1109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b9ff39-02a2-404f-b876-6766082b1109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f7bb27-6588-41bc-9cc5-9eb2a82cc16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:17 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Volume e9cb6a62-b8f3-4633-af77-58b5f69360aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa', 'volume_size': 1} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1401312031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cb6a62-b8f3-4633-af77-58b5f69360aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df52c8f3b9124599b0735b5c12a7fe06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:18Z,use_quota=True,user_id='11d2d7e8cc80402e9ec8a187f31fc097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Creating volume e9cb6a62-b8f3-4633-af77-58b5f69360aa {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:18 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:50:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:18 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa 1073741824 Jul 10 06:50:18 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "cinder-2d543115-dd46-48b5-8515-97b50006977f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-2d543115-dd46-48b5-8515-97b50006977f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "cinder-quobyte-2d543115-dd46-48b5-8515-97b50006977f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-quobyte-2d543115-dd46-48b5-8515-97b50006977f" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[482ac022-8754-4857-bea3-064aa383894f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:18 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f Jul 10 06:50:18 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:19 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa 1073741824" returned: 0 in 1.012s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:19 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa Jul 10 06:50:19 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:19 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f" returned: 0 in 0.889s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:19 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f Jul 10 06:50:19 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:19 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa" returned: 0 in 0.778s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f7bb27-6588-41bc-9cc5-9eb2a82cc16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146eaaf3-414e-46e7-9750-63a21eb7182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:19 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Volume volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa (e9cb6a62-b8f3-4633-af77-58b5f69360aa): created successfully Jul 10 06:50:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146eaaf3-414e-46e7-9750-63a21eb7182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Flow 'volume_create_manager' (0fcb2541-fe18-4b7f-956d-1d39387ea203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7d1534ec-5832-4a08-9dc3-f5ac03f154bd tempest-SnapshotMetadataTestJSON-1208502343 None] Created volume successfully. Jul 10 06:50:20 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d543115-dd46-48b5-8515-97b50006977f" returned: 0 in 0.763s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-quobyte-2d543115-dd46-48b5-8515-97b50006977f" released by "delete_volume" :: held 1.712s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Created reservations ['4bfe5d27-d558-4cb7-91a6-6e21041ee6ba', 'e333472e-a0a5-4314-9053-acf8852dec2c', '38e1f276-6e21-46d5-8887-f9372437570a', '2866ddcc-68a9-4d49-a463-9bab18693eda'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:20 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:50:20 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "cinder-3e3c8920-ffdd-4297-a1dd-2da2285f79d2-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-3e3c8920-ffdd-4297-a1dd-2da2285f79d2-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "cinder-quobyte-3e3c8920-ffdd-4297-a1dd-2da2285f79d2" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-quobyte-3e3c8920-ffdd-4297-a1dd-2da2285f79d2" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c2786c-463b-4cb2-9687-c74332d05f52]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:20 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 Jul 10 06:50:20 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:21 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.868s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:21 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Deleted volume successfully. Jul 10 06:50:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7c96dae7-853b-4fde-9e95-ccd6fcb37ed5 tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-2d543115-dd46-48b5-8515-97b50006977f-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] Creating offline snapshot 75a25da8-5d3a-4e7c-8c67-2bd49a91a83a of volume e9cb6a62-b8f3-4633-af77-58b5f69360aa {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:50:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[243ffbbd-2f5c-4638-abd2-cd1f96af9548]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:21 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa Jul 10 06:50:21 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:21 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2" returned: 0 in 1.021s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:21 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2 Jul 10 06:50:21 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:22 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa" returned: 0 in 1.032s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:22 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a 1G Jul 10 06:50:22 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:22 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3e3c8920-ffdd-4297-a1dd-2da2285f79d2" returned: 0 in 0.836s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-quobyte-3e3c8920-ffdd-4297-a1dd-2da2285f79d2" released by "delete_volume" :: held 1.918s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=120,cinder:SELECT=99,cinder:INSERT=34,cinder:DELETE=9 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Created reservations ['25a87403-2582-4b73-a31d-7a532e00fba0', 'eb299844-d892-4dc3-b06a-36ad0f8e6261', '1c52693b-c334-4a76-ba68-c2b47b254971', '06038bbf-d38a-4ce5-b8f2-68b532478582'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:22 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:50:22 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "cinder-7ef05296-485f-40aa-ba2c-cb237f1be536-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-7ef05296-485f-40aa-ba2c-cb237f1be536-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "cinder-quobyte-7ef05296-485f-40aa-ba2c-cb237f1be536" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-quobyte-7ef05296-485f-40aa-ba2c-cb237f1be536" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5f77d6-40a6-4a2e-8d1b-3c4c6ebf1da9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:23 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536 Jul 10 06:50:23 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:23 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a 1G" returned: 0 in 1.320s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:23 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a Jul 10 06:50:23 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:24 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.160s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:24 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Deleted volume successfully. Jul 10 06:50:24 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=119,cinder:INSERT=25,cinder:SELECT=107,cinder:DELETE=10 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:50:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cdb7ef53-7efa-4c43-abff-9975a7819afe tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-3e3c8920-ffdd-4297-a1dd-2da2285f79d2-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:24 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536" returned: 0 in 1.055s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:24 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536 Jul 10 06:50:24 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:24 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a" returned: 0 in 1.184s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:24 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a is being set with open permissions: ugo+rw Jul 10 06:50:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:24 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a Jul 10 06:50:24 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:25 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ef05296-485f-40aa-ba2c-cb237f1be536" returned: 0 in 0.969s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-quobyte-7ef05296-485f-40aa-ba2c-cb237f1be536" released by "delete_volume" :: held 2.101s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:25 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Created reservations ['b88bf2e8-870d-418f-bc26-83a92ad88ae2', '8347ef8f-c29a-41cf-9850-9610f6b7a928', '5697a513-ac4b-4b1c-ad3c-91938b6e6d84', '111b0918-7b22-4fb7-a347-aa58cfc35f0c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:25 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:50:25 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:25 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a" returned: 0 in 0.930s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:25 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.info Jul 10 06:50:25 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:26 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.728s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:26 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Deleted volume successfully. Jul 10 06:50:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e3e3a718-2a86-4d6a-9aa6-fa3b40925585 tempest-AttachVolumeTestJSON-1394904718 None] Lock "cinder-7ef05296-485f-40aa-ba2c-cb237f1be536-delete_volume" released by "delete_volume" :: held 3.192s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:26 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.info" returned: 0 in 0.769s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:26 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.info is being set with open permissions: ugo+rw Jul 10 06:50:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:26 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.info Jul 10 06:50:26 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:27 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.info" returned: 0 in 0.803s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.171s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e511c8b0-07ea-4e8b-a7cd-d5981822fab0 tempest-SnapshotMetadataTestJSON-1208502343 None] Create snapshot completed successfully Jul 10 06:50:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Acquiring lock "cinder-75a25da8-5d3a-4e7c-8c67-2bd49a91a83a-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "cinder-75a25da8-5d3a-4e7c-8c67-2bd49a91a83a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Acquiring lock "cinder-quobyte-e9cb6a62-b8f3-4633-af77-58b5f69360aa" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "cinder-quobyte-e9cb6a62-b8f3-4633-af77-58b5f69360aa" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Acquiring lock "cinder-quobyte-75a25da8-5d3a-4e7c-8c67-2bd49a91a83a" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "cinder-quobyte-75a25da8-5d3a-4e7c-8c67-2bd49a91a83a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Deleting offline snapshot 75a25da8-5d3a-4e7c-8c67-2bd49a91a83a of volume e9cb6a62-b8f3-4633-af77-58b5f69360aa {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:50:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] snapshot_file for this snap is: volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:50:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3696d5-3aec-4177-ab6e-d84481707680]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:28 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a Jul 10 06:50:28 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:29 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a" returned: 0 in 0.894s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:50:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1cb7dd-56cc-40d0-a322-9555117a6c84]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:29 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa Jul 10 06:50:29 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:30 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa" returned: 0 in 0.947s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:30 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a Jul 10 06:50:30 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:31 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a" returned: 0 in 1.063s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:31 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a Jul 10 06:50:31 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:32 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa.75a25da8-5d3a-4e7c-8c67-2bd49a91a83a" returned: 0 in 0.786s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "cinder-quobyte-75a25da8-5d3a-4e7c-8c67-2bd49a91a83a" released by "_delete_snapshot" :: held 3.870s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "cinder-quobyte-e9cb6a62-b8f3-4633-af77-58b5f69360aa" released by "delete_snapshot" :: held 3.899s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Created reservations ['7ee694ea-b886-493b-9403-654e5549d0aa', '3135c9b6-f5d4-4e19-a1fb-fbfa8ca2a892', '366826a6-ae64-4c2c-8da8-7f8214649a1e', 'ab499a7f-8382-4a5e-9ac2-e5c7ce696370'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Delete snapshot completed successfully. Jul 10 06:50:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb61a931-8e2d-4037-bffc-a3c638552a64 tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "cinder-75a25da8-5d3a-4e7c-8c67-2bd49a91a83a-delete_snapshot" released by "delete_snapshot" :: held 4.085s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Acquiring lock "cinder-e9cb6a62-b8f3-4633-af77-58b5f69360aa-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "cinder-e9cb6a62-b8f3-4633-af77-58b5f69360aa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Acquiring lock "cinder-quobyte-e9cb6a62-b8f3-4633-af77-58b5f69360aa" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "cinder-quobyte-e9cb6a62-b8f3-4633-af77-58b5f69360aa" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cea69c-1a64-45ad-bda9-be06b6fa4a54]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:33 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa Jul 10 06:50:33 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:34 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa" returned: 0 in 0.950s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:34 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa Jul 10 06:50:34 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:34 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e9cb6a62-b8f3-4633-af77-58b5f69360aa" returned: 0 in 0.827s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "cinder-quobyte-e9cb6a62-b8f3-4633-af77-58b5f69360aa" released by "delete_volume" :: held 1.870s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:34 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Created reservations ['9f27e55c-e71f-4b1a-874f-6b563e404744', '6b89525a-3b8d-4048-baca-cdce59912af7', '52926bee-838f-4c13-aa1e-7e67a0050565', '291ffc0a-7fb7-4b4f-bed5-c243058fbe71'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:35 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:50:35 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:36 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.028s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:36 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Deleted volume successfully. Jul 10 06:50:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eac9f8a7-f819-4a42-a95d-9d2c383cd4fb tempest-SnapshotMetadataTestJSON-1208502343 None] Lock "cinder-e9cb6a62-b8f3-4633-af77-58b5f69360aa-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Flow 'volume_create_manager' (caf93e3a-a35f-47dc-ae8b-0bcab1c951b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea71f57-cf5e-4538-9edc-4a6952de1a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea71f57-cf5e-4538-9edc-4a6952de1a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-875041913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8215af02-1086-4cd9-b5a1-9cb8dfa85375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e03474f2565845ea88d6348bb1393373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:41Z,use_quota=True,user_id='57067fa0b0824a05abd18916ab215d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59d83e8-536b-43bb-9129-902e241a2105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59d83e8-536b-43bb-9129-902e241a2105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78489b7f-7f86-4905-8d2e-825aeeda6c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78489b7f-7f86-4905-8d2e-825aeeda6c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8215af02-1086-4cd9-b5a1-9cb8dfa85375', 'volume_name': 'volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d5e625-1ce9-4d1a-bcf3-b7a4b00f6fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d5e625-1ce9-4d1a-bcf3-b7a4b00f6fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f432b05-5247-4535-9b22-ef75313e5073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Volume 8215af02-1086-4cd9-b5a1-9cb8dfa85375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375', 'volume_size': 1} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-875041913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8215af02-1086-4cd9-b5a1-9cb8dfa85375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e03474f2565845ea88d6348bb1393373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:41Z,use_quota=True,user_id='57067fa0b0824a05abd18916ab215d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Creating volume 8215af02-1086-4cd9-b5a1-9cb8dfa85375 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:40 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:50:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:40 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375 1073741824 Jul 10 06:50:40 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:41 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375 1073741824" returned: 0 in 1.047s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:41 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375 Jul 10 06:50:41 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:42 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375" returned: 0 in 0.732s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f432b05-5247-4535-9b22-ef75313e5073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64df5eef-4cc7-4c74-8562-fa79bf70d7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Volume volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375 (8215af02-1086-4cd9-b5a1-9cb8dfa85375): created successfully Jul 10 06:50:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64df5eef-4cc7-4c74-8562-fa79bf70d7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Flow 'volume_create_manager' (caf93e3a-a35f-47dc-ae8b-0bcab1c951b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4a330313-2d7b-477f-986b-91b79217cdef tempest-AbsoluteLimitsTests-1112399804 None] Created volume successfully. Jul 10 06:50:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Acquiring lock "cinder-8215af02-1086-4cd9-b5a1-9cb8dfa85375-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Lock "cinder-8215af02-1086-4cd9-b5a1-9cb8dfa85375-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Acquiring lock "cinder-quobyte-8215af02-1086-4cd9-b5a1-9cb8dfa85375" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Lock "cinder-quobyte-8215af02-1086-4cd9-b5a1-9cb8dfa85375" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:43 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b10f025-1587-4a29-bc41-48483678a4f2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:43 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375 Jul 10 06:50:43 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:43 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Flow 'volume_create_manager' (a769957d-0900-4f7d-9143-2bd6f5f957b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034be15d-ad26-457b-8378-8b3273d8f1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034be15d-ad26-457b-8378-8b3273d8f1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1887602832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f5c0d4-2e3b-4840-8b2d-0360d055931e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed789a4154c94b2aab3686dfbd16029b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:44Z,use_quota=True,user_id='f10f5a89cfe048958a0d9d64d0e2c227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b101835a-9bc9-4a4d-8476-4c7fe2fe9fdd),volume_type_id=b101835a-9bc9-4a4d-8476-4c7fe2fe9fdd)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13840713-8d1e-44b2-8f0c-48768752da0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13840713-8d1e-44b2-8f0c-48768752da0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f43b08-2325-4cc1-84ef-589040a156cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f43b08-2325-4cc1-84ef-589040a156cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f5c0d4-2e3b-4840-8b2d-0360d055931e', 'volume_name': 'volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e101efa6-7d63-48b5-b612-f30dd31a7b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e101efa6-7d63-48b5-b612-f30dd31a7b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace03cda-7817-406a-8f6a-af9bd9fc0d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Volume f7f5c0d4-2e3b-4840-8b2d-0360d055931e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e', 'volume_size': 1} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1887602832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f5c0d4-2e3b-4840-8b2d-0360d055931e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed789a4154c94b2aab3686dfbd16029b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:44Z,use_quota=True,user_id='f10f5a89cfe048958a0d9d64d0e2c227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b101835a-9bc9-4a4d-8476-4c7fe2fe9fdd),volume_type_id=b101835a-9bc9-4a4d-8476-4c7fe2fe9fdd)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Creating volume f7f5c0d4-2e3b-4840-8b2d-0360d055931e {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:44 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375" returned: 0 in 1.059s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:44 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e 1073741824 Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:44 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:44 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375 Jul 10 06:50:44 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Flow 'volume_create_manager' (b2935d9a-ac00-498b-8eff-556aeb4036c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ce28e8-bde5-4213-8f1d-af54cc6407e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ce28e8-bde5-4213-8f1d-af54cc6407e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1952513010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b906af76-4526-4fee-9d1d-7d42bef19b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877b9926c766475f83be4d394796aeb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:44Z,use_quota=True,user_id='1a5e9bfb59fe491590b7d5660e530e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49045c4-381e-4498-868d-a6c928418cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49045c4-381e-4498-868d-a6c928418cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dff73cd-923b-4dab-9ef5-01419dc91441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dff73cd-923b-4dab-9ef5-01419dc91441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b906af76-4526-4fee-9d1d-7d42bef19b20', 'volume_name': 'volume-b906af76-4526-4fee-9d1d-7d42bef19b20', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b1ce14-d651-486d-aa73-ef47b5771335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b1ce14-d651-486d-aa73-ef47b5771335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0a0586-07c0-4811-bbb8-c3560f05e5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Volume b906af76-4526-4fee-9d1d-7d42bef19b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b906af76-4526-4fee-9d1d-7d42bef19b20', 'volume_size': 1} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Flow 'volume_create_manager' (1f950926-6dac-430d-8e58-ad98a397f624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db564c5-61ee-4d10-96b8-0c53b652a937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db564c5-61ee-4d10-96b8-0c53b652a937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1112972668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed789a4154c94b2aab3686dfbd16029b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:44Z,use_quota=True,user_id='f10f5a89cfe048958a0d9d64d0e2c227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dff2d76-2541-439a-a777-10d2d3e499ed),volume_type_id=1dff2d76-2541-439a-a777-10d2d3e499ed)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89c8b8b-24c2-4618-a984-8ddb6d3acd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89c8b8b-24c2-4618-a984-8ddb6d3acd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84be3c5b-36ca-45fb-a8bb-7bbced1cacea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84be3c5b-36ca-45fb-a8bb-7bbced1cacea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41', 'volume_name': 'volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf5afa5-690f-4e41-9a8f-544f654e6c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf5afa5-690f-4e41-9a8f-544f654e6c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c8cb63-b8c0-420b-aae4-f1f01cd7471e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Volume 1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41', 'volume_size': 1} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:44 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8215af02-1086-4cd9-b5a1-9cb8dfa85375" returned: 0 in 0.847s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Lock "cinder-quobyte-8215af02-1086-4cd9-b5a1-9cb8dfa85375" released by "delete_volume" :: held 1.961s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Flow 'volume_create_manager' (a8bc5711-2d3e-42fb-a8bb-c542d7d7394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f3dbd2-a0d8-4213-9fef-aca12fb69416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f3dbd2-a0d8-4213-9fef-aca12fb69416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-99767695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585c6ce8-0270-429c-8158-8f5e13e47717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed789a4154c94b2aab3686dfbd16029b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:45Z,use_quota=True,user_id='f10f5a89cfe048958a0d9d64d0e2c227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9905857-9bcb-4383-a7fd-d7bd1a1fa510),volume_type_id=d9905857-9bcb-4383-a7fd-d7bd1a1fa510)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e99411a-b7bd-4b4c-bf9c-f59b0e692d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e99411a-b7bd-4b4c-bf9c-f59b0e692d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4058b5-df90-49d8-ba1b-674af0b8f28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Created reservations ['297632ca-5e80-4759-b38b-abb263f1b750', '993c9bd9-98a9-4db0-a96b-0c592db24c66', 'b4dc8a5e-7c7b-42a2-ab07-ef7b59e353a1', '09df50ea-4ad4-43ea-9d88-f3bccc360aab'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:45 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e 1073741824" returned: 0 in 1.157s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:45 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:50:45 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:45 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e Jul 10 06:50:45 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4058b5-df90-49d8-ba1b-674af0b8f28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '585c6ce8-0270-429c-8158-8f5e13e47717', 'volume_name': 'volume-585c6ce8-0270-429c-8158-8f5e13e47717', 'volume_size': 1, 'image_id': '9dd90a69-874e-4722-971c-559d7057c7a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dd90a69-874e-4722-971c-559d7057c7a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1585745723', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed789a4154c94b2aab3686dfbd16029b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dd90a69-874e-4722-971c-559d7057c7a0', 'created_at': datetime.datetime(2026, 7, 10, 4, 50, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 50, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dd90a69-874e-4722-971c-559d7057c7a0/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a47f7a-40c3-4aa0-9279-ca65b3c66acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a47f7a-40c3-4aa0-9279-ca65b3c66acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2d1b9d-9568-4499-9158-398bbe8a8d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Volume 585c6ce8-0270-429c-8158-8f5e13e47717: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-585c6ce8-0270-429c-8158-8f5e13e47717', 'volume_size': 1, 'image_id': '9dd90a69-874e-4722-971c-559d7057c7a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dd90a69-874e-4722-971c-559d7057c7a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1585745723', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed789a4154c94b2aab3686dfbd16029b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dd90a69-874e-4722-971c-559d7057c7a0', 'created_at': datetime.datetime(2026, 7, 10, 4, 50, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 50, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dd90a69-874e-4722-971c-559d7057c7a0/file', 'properties': {}}, 'image_service': } Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Trying to clone 585c6ce8-0270-429c-8158-8f5e13e47717 from image 9dd90a69-874e-4722-971c-559d7057c7a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9dd90a69-874e-4722-971c-559d7057c7a0', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:50:45 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.711s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Deleted volume successfully. Jul 10 06:50:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b22740d-f7d3-4e1b-a582-42ae5bd6cf3d tempest-AbsoluteLimitsTests-1112399804 None] Lock "cinder-8215af02-1086-4cd9-b5a1-9cb8dfa85375-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:46 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e" returned: 0 in 0.773s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.751s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1952513010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b906af76-4526-4fee-9d1d-7d42bef19b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='877b9926c766475f83be4d394796aeb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:44Z,use_quota=True,user_id='1a5e9bfb59fe491590b7d5660e530e8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Creating volume b906af76-4526-4fee-9d1d-7d42bef19b20 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:46 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:46 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20 1073741824 Jul 10 06:50:46 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace03cda-7817-406a-8f6a-af9bd9fc0d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181265c6-067a-4c06-8330-ceab3860e5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Volume volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e (f7f5c0d4-2e3b-4840-8b2d-0360d055931e): created successfully Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181265c6-067a-4c06-8330-ceab3860e5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Flow 'volume_create_manager' (a769957d-0900-4f7d-9143-2bd6f5f957b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7209cdbe-e3ce-4509-a503-a272ea8815f4 tempest-TestInstancesWithCinderVolumes-1682914667 None] Created volume successfully. Jul 10 06:50:47 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20 1073741824" returned: 0 in 1.097s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:47 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20 Jul 10 06:50:47 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:47 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20" returned: 0 in 0.709s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.478s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1112972668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed789a4154c94b2aab3686dfbd16029b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:44Z,use_quota=True,user_id='f10f5a89cfe048958a0d9d64d0e2c227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dff2d76-2541-439a-a777-10d2d3e499ed),volume_type_id=1dff2d76-2541-439a-a777-10d2d3e499ed)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Creating volume 1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:47 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:47 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 1073741824 Jul 10 06:50:47 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0a0586-07c0-4811-bbb8-c3560f05e5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b906af76-4526-4fee-9d1d-7d42bef19b20', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26c402c-3cbd-4bef-bfb9-3b740ad09660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Volume volume-b906af76-4526-4fee-9d1d-7d42bef19b20 (b906af76-4526-4fee-9d1d-7d42bef19b20): created successfully Jul 10 06:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26c402c-3cbd-4bef-bfb9-3b740ad09660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Flow 'volume_create_manager' (b2935d9a-ac00-498b-8eff-556aeb4036c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1d82859c-97b2-4e30-bb77-27a76987ef48 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Created volume successfully. Jul 10 06:50:48 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 1073741824" returned: 0 in 1.062s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:49 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 Jul 10 06:50:49 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:49 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD, size 20.69 MB, duration 3.96 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:50:49 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Image download 20.69 MB at 5.23 MB/s Jul 10 06:50:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[563713ae-d801-46bb-bc23-53d260284fc2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:49 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD Jul 10 06:50:49 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:49 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41" returned: 0 in 0.870s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c8cb63-b8c0-420b-aae4-f1f01cd7471e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf72f6fb-beea-4ada-85d5-b33285137225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:49 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Volume volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 (1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41): created successfully Jul 10 06:50:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf72f6fb-beea-4ada-85d5-b33285137225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Flow 'volume_create_manager' (1f950926-6dac-430d-8e58-ad98a397f624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7c8e7f8c-b5ba-45d7-8f95-79fe2bc42e27 tempest-TestInstancesWithCinderVolumes-1682914667 None] Created volume successfully. Jul 10 06:50:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Acquiring lock "cinder-b906af76-4526-4fee-9d1d-7d42bef19b20-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Lock "cinder-b906af76-4526-4fee-9d1d-7d42bef19b20-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Acquiring lock "cinder-quobyte-b906af76-4526-4fee-9d1d-7d42bef19b20" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:50 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Lock "cinder-quobyte-b906af76-4526-4fee-9d1d-7d42bef19b20" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD" returned: 0 in 0.971s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:50 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Temporary image 9dd90a69-874e-4722-971c-559d7057c7a0 is fetched for user f10f5a89cfe048958a0d9d64d0e2c227. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:50:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2210984-9cda-4ed5-997b-92a773001653]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fbaa87-f1e6-41a7-9a96-a4dc06b03cc9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:50 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20 Jul 10 06:50:50 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:50 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD Jul 10 06:50:50 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:51 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:51 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD" returned: 0 in 0.746s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20" returned: 0 in 0.824s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-99767695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585c6ce8-0270-429c-8158-8f5e13e47717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed789a4154c94b2aab3686dfbd16029b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:45Z,use_quota=True,user_id='f10f5a89cfe048958a0d9d64d0e2c227',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9905857-9bcb-4383-a7fd-d7bd1a1fa510),volume_type_id=d9905857-9bcb-4383-a7fd-d7bd1a1fa510)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Creating volume 585c6ce8-0270-429c-8158-8f5e13e47717 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:51 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:51 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 1073741824 Jul 10 06:50:51 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:51 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20 Jul 10 06:50:51 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:52 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b906af76-4526-4fee-9d1d-7d42bef19b20" returned: 0 in 0.766s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Lock "cinder-quobyte-b906af76-4526-4fee-9d1d-7d42bef19b20" released by "delete_volume" :: held 1.668s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:52 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Created reservations ['6f969ed2-c01f-45c5-9df3-e205f8ebcb3d', '88694a93-d900-4741-a38d-4a2e672a08ba', '716a657d-5fae-4019-9b6a-4eaccc496b8c', '2813d78b-9eea-4194-be40-b42caf3cc58d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:52 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:50:52 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:52 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 1073741824" returned: 0 in 1.029s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:52 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 Jul 10 06:50:52 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:53 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.874s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:53 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Deleted volume successfully. Jul 10 06:50:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-26a4dbab-32d1-4f64-932c-3ee3c9f6b7e2 tempest-VolumeQuotasNegativeTestJSON-461415676 None] Lock "cinder-b906af76-4526-4fee-9d1d-7d42bef19b20-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:53 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717" returned: 0 in 0.840s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:53 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Attempting download of 9dd90a69-874e-4722-971c-559d7057c7a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dd90a69-874e-4722-971c-559d7057c7a0', 'metadata': {}}])) to volume 585c6ce8-0270-429c-8158-8f5e13e47717. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:50:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cf8385-ffeb-4946-b708-2bb3be93328f]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dd90a69-874e-4722-971c-559d7057c7a0__3i6tddt {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:53 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dd90a69-874e-4722-971c-559d7057c7a0__3i6tddt Jul 10 06:50:53 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:54 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9dd90a69-874e-4722-971c-559d7057c7a0__3i6tddt" returned: 0 in 0.833s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dd90a69-874e-4722-971c-559d7057c7a0__3i6tddt {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:54 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dd90a69-874e-4722-971c-559d7057c7a0__3i6tddt Jul 10 06:50:54 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:55 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dd90a69-874e-4722-971c-559d7057c7a0__3i6tddt" returned: 1 in 0.885s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9dd90a69-874e-4722-971c-559d7057c7a0__3i6tddt' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:50:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42f2d5b-3293-4d1a-b26c-03d931295c9b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:55 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD Jul 10 06:50:55 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:55 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD" returned: 0 in 0.849s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:55 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] 9dd90a69-874e-4722-971c-559d7057c7a0 was qcow2, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:50:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:55 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 Jul 10 06:50:55 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:58 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717" returned: 0 in 2.429s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:58 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9dd90a69-874e-4722-971c-559d7057c7a0_c6zijdyjdevstack@QuobyteHD, size 112.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:50:58 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Converted 112.00 MB image at 46.08 MB/s Jul 10 06:50:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:58 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 1G Jul 10 06:50:58 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:59 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 1G" returned: 0 in 0.902s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99ff3e9-b97b-4f65-b2bb-6e3303433b84]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:59 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 Jul 10 06:50:59 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:00 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717" returned: 0 in 0.902s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:00 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 Jul 10 06:51:00 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:01 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717" returned: 1 in 0.817s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:51:01 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Downloaded image 9dd90a69-874e-4722-971c-559d7057c7a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/9dd90a69-874e-4722-971c-559d7057c7a0', 'metadata': {}}])) to volume 585c6ce8-0270-429c-8158-8f5e13e47717 successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:51:01 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Temporary image 9dd90a69-874e-4722-971c-559d7057c7a0 for user f10f5a89cfe048958a0d9d64d0e2c227 is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:51:01 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Marking volume 585c6ce8-0270-429c-8158-8f5e13e47717 as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:51:01 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Copying metadata from image 9dd90a69-874e-4722-971c-559d7057c7a0 to 585c6ce8-0270-429c-8158-8f5e13e47717. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:51:01 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Creating volume glance metadata for volume 585c6ce8-0270-429c-8158-8f5e13e47717 backed by image 9dd90a69-874e-4722-971c-559d7057c7a0 with: {'image_id': '9dd90a69-874e-4722-971c-559d7057c7a0', 'image_name': 'tempest-scenario-img--1585745723', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:51:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2d1b9d-9568-4499-9158-398bbe8a8d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585c6ce8-0270-429c-8158-8f5e13e47717', 'volume_size': 1, 'image_id': '9dd90a69-874e-4722-971c-559d7057c7a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9dd90a69-874e-4722-971c-559d7057c7a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1585745723', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ed789a4154c94b2aab3686dfbd16029b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9dd90a69-874e-4722-971c-559d7057c7a0', 'created_at': datetime.datetime(2026, 7, 10, 4, 50, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 50, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9dd90a69-874e-4722-971c-559d7057c7a0/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cb712f-4dc9-4e2b-9d49-7fb1879904bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:01 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Volume volume-585c6ce8-0270-429c-8158-8f5e13e47717 (585c6ce8-0270-429c-8158-8f5e13e47717): created successfully Jul 10 06:51:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cb712f-4dc9-4e2b-9d49-7fb1879904bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Flow 'volume_create_manager' (a8bc5711-2d3e-42fb-a8bb-c542d7d7394c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-127b216b-7b4a-4cde-9f1c-b87a63410949 tempest-TestInstancesWithCinderVolumes-1682914667 None] Created volume successfully. Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Flow 'volume_create_manager' (3d24b4b1-c9b7-43cd-99a2-a7bf6b0abd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47ab0da-d5de-4276-8cf3-403164351ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47ab0da-d5de-4276-8cf3-403164351ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-812112688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217c19e5-2ced-478b-b5d0-de9df2b0e249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999fd1c9578e4495bc754a56b41d3546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:04Z,use_quota=True,user_id='259c89ab740d45ddb1a27c363218ab47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c520ebe2-626b-4380-be48-15e7f257cd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c520ebe2-626b-4380-be48-15e7f257cd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64518b6b-d419-482d-9311-9047977a94db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64518b6b-d419-482d-9311-9047977a94db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '217c19e5-2ced-478b-b5d0-de9df2b0e249', 'volume_name': 'volume-217c19e5-2ced-478b-b5d0-de9df2b0e249', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940a2e70-8b69-4a0d-aed7-bee913469e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (940a2e70-8b69-4a0d-aed7-bee913469e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce0dcff-6217-4d5c-8cb0-1bc02c854c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Volume 217c19e5-2ced-478b-b5d0-de9df2b0e249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-217c19e5-2ced-478b-b5d0-de9df2b0e249', 'volume_size': 1} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-812112688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=217c19e5-2ced-478b-b5d0-de9df2b0e249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999fd1c9578e4495bc754a56b41d3546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:04Z,use_quota=True,user_id='259c89ab740d45ddb1a27c363218ab47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Creating volume 217c19e5-2ced-478b-b5d0-de9df2b0e249 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:04 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:51:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:04 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 1073741824 Jul 10 06:51:04 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:05 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 1073741824" returned: 0 in 1.044s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:05 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 Jul 10 06:51:05 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:06 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249" returned: 0 in 0.725s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce0dcff-6217-4d5c-8cb0-1bc02c854c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-217c19e5-2ced-478b-b5d0-de9df2b0e249', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94526e6-f701-4338-8bf1-c18abb0a4599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Volume volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 (217c19e5-2ced-478b-b5d0-de9df2b0e249): created successfully Jul 10 06:51:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94526e6-f701-4338-8bf1-c18abb0a4599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Flow 'volume_create_manager' (3d24b4b1-c9b7-43cd-99a2-a7bf6b0abd5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1442feaf-dcc0-482f-bc99-dab1e56844c8 tempest-VolumesActionsTest-897391676 None] Created volume successfully. Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Flow 'volume_create_manager' (b678ecd9-ce6f-4b07-8ecf-a64e4642f2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89bf3ba-17aa-48fa-ad94-cd41acbb23ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89bf3ba-17aa-48fa-ad94-cd41acbb23ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-602420907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d52e32-dbcc-4cd4-8eb3-75946c32eb8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7526b31bec014f3ca1a14df192d6b543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:07Z,use_quota=True,user_id='43d05dd7c56a4f01bad2d89992404932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dcf62e-93a9-466b-8061-0b7444d6fee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9dcf62e-93a9-466b-8061-0b7444d6fee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd8d6ab-a53b-4a9b-b358-25637a833610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd8d6ab-a53b-4a9b-b358-25637a833610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d52e32-dbcc-4cd4-8eb3-75946c32eb8c', 'volume_name': 'volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035f446a-f5cf-455e-9e09-4f4491d6347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035f446a-f5cf-455e-9e09-4f4491d6347a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7797ab-e4e5-4269-8346-d95561c447eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Volume 05d52e32-dbcc-4cd4-8eb3-75946c32eb8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c', 'volume_size': 1} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-602420907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d52e32-dbcc-4cd4-8eb3-75946c32eb8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7526b31bec014f3ca1a14df192d6b543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:07Z,use_quota=True,user_id='43d05dd7c56a4f01bad2d89992404932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Creating volume 05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:07 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:51:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:07 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c 1073741824 Jul 10 06:51:07 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:08 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c 1073741824" returned: 0 in 0.920s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:08 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c Jul 10 06:51:08 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:08 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" returned: 0 in 0.677s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7797ab-e4e5-4269-8346-d95561c447eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab11387-0e88-4235-a346-537243ae5472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:08 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Volume volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c (05d52e32-dbcc-4cd4-8eb3-75946c32eb8c): created successfully Jul 10 06:51:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab11387-0e88-4235-a346-537243ae5472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Flow 'volume_create_manager' (b678ecd9-ce6f-4b07-8ecf-a64e4642f2f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8be2f8ae-1e33-41c0-81e0-86e46f136519 tempest-VolumesDeleteCascade-1471084386 None] Created volume successfully. Jul 10 06:51:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] Creating offline snapshot 3de03fdf-1e29-4d40-ba90-8f1867230372 of volume 05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:51:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1824baf0-7e9b-494a-8ecc-4bb8a9ee9ba2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:09 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c Jul 10 06:51:09 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:10 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" returned: 0 in 0.896s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-f5889f71-5f9f-4046-bf4c-ab5b7fe9bfdf req-cf73c476-ed4c-4168-be06-b1c74dbae6c6 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:10 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 1G Jul 10 06:51:10 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:11 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 1G" returned: 0 in 0.901s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:11 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 Jul 10 06:51:11 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:51:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:11 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:51:11 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:12 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372" returned: 0 in 0.795s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:12 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 is being set with open permissions: ugo+rw Jul 10 06:51:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:12 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 Jul 10 06:51:12 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:12 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.727s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:51:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:51:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:51:12 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372" returned: 0 in 0.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:12 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.info Jul 10 06:51:12 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:13 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.info" returned: 0 in 0.870s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:13 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.info is being set with open permissions: ugo+rw Jul 10 06:51:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:13 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.info Jul 10 06:51:13 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:14 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.info" returned: 0 in 0.696s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.040s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-f5889f71-5f9f-4046-bf4c-ab5b7fe9bfdf req-cf73c476-ed4c-4168-be06-b1c74dbae6c6 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.058s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-10da439a-3b0c-4d41-afe2-04465a5e80aa tempest-VolumesDeleteCascade-1471084386 None] Create snapshot completed successfully Jul 10 06:51:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[53153bd3-0fc5-4f6b-80c2-6f11c987e2cc]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f5889f71-5f9f-4046-bf4c-ab5b7fe9bfdf req-cf73c476-ed4c-4168-be06-b1c74dbae6c6 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:14 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 Jul 10 06:51:14 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:15 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f5889f71-5f9f-4046-bf4c-ab5b7fe9bfdf req-cf73c476-ed4c-4168-be06-b1c74dbae6c6 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717" returned: 0 in 0.875s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f5889f71-5f9f-4046-bf4c-ab5b7fe9bfdf req-cf73c476-ed4c-4168-be06-b1c74dbae6c6 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:15 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 Jul 10 06:51:15 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:16 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f5889f71-5f9f-4046-bf4c-ab5b7fe9bfdf req-cf73c476-ed4c-4168-be06-b1c74dbae6c6 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717" returned: 1 in 0.764s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-f5889f71-5f9f-4046-bf4c-ab5b7fe9bfdf req-cf73c476-ed4c-4168-be06-b1c74dbae6c6 tempest-TestInstancesWithCinderVolumes-1682914667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:51:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-f5889f71-5f9f-4046-bf4c-ab5b7fe9bfdf req-cf73c476-ed4c-4168-be06-b1c74dbae6c6 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.682s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.246s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] Creating offline snapshot 775706f6-1369-4d57-b873-a39bbe022b6a of volume 05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:51:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-f5889f71-5f9f-4046-bf4c-ab5b7fe9bfdf req-cf73c476-ed4c-4168-be06-b1c74dbae6c6 tempest-TestInstancesWithCinderVolumes-1682914667 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-585c6ce8-0270-429c-8158-8f5e13e47717', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcb34f8d-dfed-4d0a-9ab6-0170ccd125ea', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:51:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1ab5ae-b356-417c-a4f7-b062a1929a85]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-f5889f71-5f9f-4046-bf4c-ab5b7fe9bfdf req-cf73c476-ed4c-4168-be06-b1c74dbae6c6 tempest-TestInstancesWithCinderVolumes-1682914667 None] attachment_update completed successfully. Jul 10 06:51:16 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 Jul 10 06:51:16 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:17 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372" returned: 0 in 0.844s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:51:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:17 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a 1G Jul 10 06:51:17 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:18 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a 1G" returned: 0 in 1.164s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:18 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a Jul 10 06:51:18 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:19 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a" returned: 0 in 0.909s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:19 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a is being set with open permissions: ugo+rw Jul 10 06:51:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:19 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a Jul 10 06:51:19 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:20 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a" returned: 0 in 1.080s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.135s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b5f06249-6a92-42bb-99d5-c74185d42ff8 tempest-VolumesDeleteCascade-1471084386 None] Create snapshot completed successfully Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Performing cascade delete. {{(pid=86966) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-3de03fdf-1e29-4d40-ba90-8f1867230372-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-3de03fdf-1e29-4d40-ba90-8f1867230372-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-quobyte-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-quobyte-3de03fdf-1e29-4d40-ba90-8f1867230372" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-3de03fdf-1e29-4d40-ba90-8f1867230372" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Deleting offline snapshot 3de03fdf-1e29-4d40-ba90-8f1867230372 of volume 05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] snapshot_file for this snap is: volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[351a4a86-a9c0-4f8c-a704-e44997630d3f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:21 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 Jul 10 06:51:21 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:22 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372" returned: 0 in 0.931s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:51:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[81620808-7291-4233-a8cf-c13a0e891beb]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:22 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c Jul 10 06:51:22 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-86319c5e-7de3-4714-a9b8-47273f628bb2 tempest-VolumesActionsTest-897391676 None] Acquiring lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249" by "attach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-86319c5e-7de3-4714-a9b8-47273f628bb2 tempest-VolumesActionsTest-897391676 None] Lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249" acquired by "attach_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:23 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=58,cinder:INSERT=26,cinder:UPDATE=73,cinder:DELETE=7 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:51:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-86319c5e-7de3-4714-a9b8-47273f628bb2 tempest-VolumesActionsTest-897391676 None] Attaching volume 217c19e5-2ced-478b-b5d0-de9df2b0e249 to instance 5aeea394-e96c-48a9-99be-695001c62645 at mountpoint /dev/vdb on host None. Jul 10 06:51:23 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" returned: 0 in 1.195s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c70721-ffef-4055-a412-50cd12eb6b33]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-86319c5e-7de3-4714-a9b8-47273f628bb2 tempest-VolumesActionsTest-897391676 None] Attach volume completed successfully. Jul 10 06:51:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-86319c5e-7de3-4714-a9b8-47273f628bb2 tempest-VolumesActionsTest-897391676 None] Lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249" released by "attach_volume" :: held 0.328s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:24 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a Jul 10 06:51:24 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f82596aa-14ad-4736-be83-17f16e90832e tempest-VolumesActionsTest-897391676 None] Acquiring lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249-detach_volume" by "detach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f82596aa-14ad-4736-be83-17f16e90832e tempest-VolumesActionsTest-897391676 None] Lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f82596aa-14ad-4736-be83-17f16e90832e tempest-VolumesActionsTest-897391676 None] Detaching volume 217c19e5-2ced-478b-b5d0-de9df2b0e249 from instance 5aeea394-e96c-48a9-99be-695001c62645. Jul 10 06:51:24 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=72,cinder:INSERT=16,cinder:UPDATE=69,cinder:DELETE=7 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:51:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f82596aa-14ad-4736-be83-17f16e90832e tempest-VolumesActionsTest-897391676 None] Detach volume completed successfully. Jul 10 06:51:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f82596aa-14ad-4736-be83-17f16e90832e tempest-VolumesActionsTest-897391676 None] Lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249-detach_volume" released by "detach_volume" :: held 0.219s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:25 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a" returned: 0 in 1.355s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:51:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[96afbdd3-869b-49b8-858d-634134ea6e1a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:25 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 Jul 10 06:51:25 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:26 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372" returned: 0 in 1.160s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:51:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b627851-0950-4d10-9df9-134c6f6ff866]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:26 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c Jul 10 06:51:26 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:27 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" returned: 0 in 1.353s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:27 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 Jul 10 06:51:27 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:29 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372" returned: 0 in 1.220s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:29 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372 Jul 10 06:51:29 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:30 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.3de03fdf-1e29-4d40-ba90-8f1867230372" returned: 0 in 1.021s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a -F qcow2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:30 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a -F qcow2 Jul 10 06:51:30 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:31 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a -F qcow2" returned: 0 in 0.881s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-3de03fdf-1e29-4d40-ba90-8f1867230372" released by "_delete_snapshot" :: held 9.430s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" released by "delete_snapshot" :: held 9.475s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Created reservations ['4cb77729-bd20-4f08-a49c-acf88388b633', '973601e2-ebcb-4a2a-aea5-354354d6120b', 'b7f86d03-d95d-4418-bfa3-4949fc44b386', '6f892fcb-b62e-4758-9ab6-b252dd38dd62'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Delete snapshot completed successfully. Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-3de03fdf-1e29-4d40-ba90-8f1867230372-delete_snapshot" released by "delete_snapshot" :: held 9.728s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-775706f6-1369-4d57-b873-a39bbe022b6a-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-775706f6-1369-4d57-b873-a39bbe022b6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-quobyte-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-quobyte-775706f6-1369-4d57-b873-a39bbe022b6a" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-775706f6-1369-4d57-b873-a39bbe022b6a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Deleting offline snapshot 775706f6-1369-4d57-b873-a39bbe022b6a of volume 05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] snapshot_file for this snap is: volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c5aacd-411d-49b9-9679-7aa993fb7a48]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:31 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a Jul 10 06:51:31 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:32 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a" returned: 0 in 0.900s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:51:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7908c3e8-1272-47b1-9d22-e8b6db64d920]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:32 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c Jul 10 06:51:32 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:33 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" returned: 0 in 1.105s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:33 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a Jul 10 06:51:33 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:34 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a" returned: 0 in 1.116s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:34 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a Jul 10 06:51:34 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:35 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c.775706f6-1369-4d57-b873-a39bbe022b6a" returned: 0 in 0.790s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-775706f6-1369-4d57-b873-a39bbe022b6a" released by "_delete_snapshot" :: held 4.036s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" released by "delete_snapshot" :: held 4.065s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:35 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Created reservations ['d154333b-f4ae-4061-bbc7-a8f2a7c55876', '4f8730cf-63f4-487c-8fbd-cc3869f99f7d', 'b32d42c6-784c-4595-ba4f-087b0779962e', 'f79832bc-6d2d-4513-8244-9d7c0bb6c1c5'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Delete snapshot completed successfully. Jul 10 06:51:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-775706f6-1369-4d57-b873-a39bbe022b6a-delete_snapshot" released by "delete_snapshot" :: held 4.255s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Snapshots deleted, issuing volume delete {{(pid=86966) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 06:51:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-quobyte-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[336406bf-7b6e-4cc7-b571-c2c204036854]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:35 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c Jul 10 06:51:35 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:36 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" returned: 0 in 0.853s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:36 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c Jul 10 06:51:36 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:37 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" returned: 0 in 0.681s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c" released by "delete_volume" :: held 1.614s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:37 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Created reservations ['f2c3a206-8128-4f6c-826b-c2ea5a3808d5', '0196e68c-7636-4618-9734-f6a3c57eb356', '7844cdaa-c2f7-4294-80d4-dacf7e2f6dc2', 'da8d4fa6-2a94-4b74-beba-7610fe0f0057'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:37 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:51:37 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:38 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.666s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Deleted volume successfully. Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b975b9fc-5211-40ea-a0e9-f0087c3b003c tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-05d52e32-dbcc-4cd4-8eb3-75946c32eb8c-delete_volume" released by "delete_volume" :: held 16.659s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Flow 'volume_create_manager' (603ed782-1535-46cb-8c48-ab2ddbe14096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d35e3b7-bd68-4bac-b0bd-1eb3ea39144e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d35e3b7-bd68-4bac-b0bd-1eb3ea39144e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-38293843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eadcff0-fb37-4973-8918-8a37c73b2e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7526b31bec014f3ca1a14df192d6b543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:39Z,use_quota=True,user_id='43d05dd7c56a4f01bad2d89992404932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a629424f-989c-477c-93fd-6d83175286a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a629424f-989c-477c-93fd-6d83175286a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92b292b-e057-47a3-87a1-6946ab1af7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92b292b-e057-47a3-87a1-6946ab1af7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eadcff0-fb37-4973-8918-8a37c73b2e6c', 'volume_name': 'volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f07d4e2-aead-402f-ba75-3953e6f376b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f07d4e2-aead-402f-ba75-3953e6f376b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6737ae2-d1b0-4ad3-8fe0-68704d9826e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:39 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Volume 6eadcff0-fb37-4973-8918-8a37c73b2e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c', 'volume_size': 1} Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-38293843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eadcff0-fb37-4973-8918-8a37c73b2e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7526b31bec014f3ca1a14df192d6b543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:39Z,use_quota=True,user_id='43d05dd7c56a4f01bad2d89992404932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Creating volume 6eadcff0-fb37-4973-8918-8a37c73b2e6c {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:39 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:51:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:39 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c 1073741824 Jul 10 06:51:39 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:40 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c 1073741824" returned: 0 in 1.313s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:40 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c Jul 10 06:51:40 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:41 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c" returned: 0 in 0.803s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6737ae2-d1b0-4ad3-8fe0-68704d9826e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454e69d9-2272-4dbc-95d5-a97a76ebf1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:41 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Volume volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c (6eadcff0-fb37-4973-8918-8a37c73b2e6c): created successfully Jul 10 06:51:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454e69d9-2272-4dbc-95d5-a97a76ebf1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Flow 'volume_create_manager' (603ed782-1535-46cb-8c48-ab2ddbe14096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:41 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-73a21447-225b-4654-8686-e3a0c84ef34a tempest-VolumesDeleteCascade-1471084386 None] Created volume successfully. Jul 10 06:51:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] Creating offline snapshot 8be98538-7679-40ab-8b76-78779e2a2db2 of volume 6eadcff0-fb37-4973-8918-8a37c73b2e6c {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:51:42 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32be2c5-ca3b-4439-afba-305af9fc869e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:42 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c Jul 10 06:51:42 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:43 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c" returned: 0 in 0.748s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:43 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 1G Jul 10 06:51:43 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:43 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 1G" returned: 0 in 0.805s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:43 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 Jul 10 06:51:43 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:44 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2" returned: 0 in 0.829s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:44 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 is being set with open permissions: ugo+rw Jul 10 06:51:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:44 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 Jul 10 06:51:44 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:45 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2" returned: 0 in 0.854s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:45 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.info Jul 10 06:51:45 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:46 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.info" returned: 0 in 0.708s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:46 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.info is being set with open permissions: ugo+rw Jul 10 06:51:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:46 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.info Jul 10 06:51:46 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:47 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.info" returned: 0 in 0.837s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.889s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f774f6ee-9e3f-4546-b9b5-3a84a2b5ab65 tempest-VolumesDeleteCascade-1471084386 None] Create snapshot completed successfully Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Flow 'volume_create_manager' (98161fa9-1925-48c6-a9e6-d999c107e423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4496decc-d114-4782-8823-b981c89c00d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4496decc-d114-4782-8823-b981c89c00d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-276482180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77157689-d436-4a01-a9af-aa62d5d02fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7526b31bec014f3ca1a14df192d6b543',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8be98538-7679-40ab-8b76-78779e2a2db2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:48Z,use_quota=True,user_id='43d05dd7c56a4f01bad2d89992404932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24941c42-11ab-4e86-9390-8cbae97b66c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24941c42-11ab-4e86-9390-8cbae97b66c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede31eda-0409-44e4-9c3a-19972a02360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede31eda-0409-44e4-9c3a-19972a02360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '77157689-d436-4a01-a9af-aa62d5d02fc0', 'volume_name': 'volume-77157689-d436-4a01-a9af-aa62d5d02fc0', 'volume_size': 1, 'snapshot_id': '8be98538-7679-40ab-8b76-78779e2a2db2'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557e4eda-1eaf-43f1-b249-ac1c2f6dfd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557e4eda-1eaf-43f1-b249-ac1c2f6dfd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f31b68-466f-4890-b479-d23aa7971f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Volume 77157689-d436-4a01-a9af-aa62d5d02fc0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-77157689-d436-4a01-a9af-aa62d5d02fc0', 'volume_size': 1, 'snapshot_id': '8be98538-7679-40ab-8b76-78779e2a2db2'} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-quobyte-8be98538-7679-40ab-8b76-78779e2a2db2-77157689-d436-4a01-a9af-aa62d5d02fc0" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-8be98538-7679-40ab-8b76-78779e2a2db2-77157689-d436-4a01-a9af-aa62d5d02fc0" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Creating volume 77157689-d436-4a01-a9af-aa62d5d02fc0 from snapshot 8be98538-7679-40ab-8b76-78779e2a2db2 {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-quobyte-77157689-d436-4a01-a9af-aa62d5d02fc0" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-77157689-d436-4a01-a9af-aa62d5d02fc0" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] snapshot: 8be98538-7679-40ab-8b76-78779e2a2db2, volume: 77157689-d436-4a01-a9af-aa62d5d02fc0, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaef4013-b83a-4e02-9d88-5ad64b7d4364]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:48 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 Jul 10 06:51:48 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:49 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2" returned: 0 in 0.911s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:51:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:51:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:51:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c4d536-6899-4366-a936-e1942540ae07]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:49 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c Jul 10 06:51:49 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-46c93eea-0575-4b12-8e92-3c94477fe105 tempest-VolumesActionsTest-897391676 None] Acquiring lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249" by "attach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-46c93eea-0575-4b12-8e92-3c94477fe105 tempest-VolumesActionsTest-897391676 None] Lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249" acquired by "attach_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-46c93eea-0575-4b12-8e92-3c94477fe105 tempest-VolumesActionsTest-897391676 None] Attaching volume 217c19e5-2ced-478b-b5d0-de9df2b0e249 to instance f267d50f-8b45-4080-8602-baa3e742e4b0 at mountpoint /dev/vdb on host None. Jul 10 06:51:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-46c93eea-0575-4b12-8e92-3c94477fe105 tempest-VolumesActionsTest-897391676 None] Attach volume completed successfully. Jul 10 06:51:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-46c93eea-0575-4b12-8e92-3c94477fe105 tempest-VolumesActionsTest-897391676 None] Lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249" released by "attach_volume" :: held 0.118s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e289e3d9-a714-48fe-9da4-09b96b844374 tempest-VolumesActionsTest-897391676 None] Acquiring lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249-detach_volume" by "detach_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e289e3d9-a714-48fe-9da4-09b96b844374 tempest-VolumesActionsTest-897391676 None] Lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e289e3d9-a714-48fe-9da4-09b96b844374 tempest-VolumesActionsTest-897391676 None] Detaching volume 217c19e5-2ced-478b-b5d0-de9df2b0e249 from instance f267d50f-8b45-4080-8602-baa3e742e4b0. Jul 10 06:51:50 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c" returned: 0 in 0.987s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:50 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:51:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e289e3d9-a714-48fe-9da4-09b96b844374 tempest-VolumesActionsTest-897391676 None] Detach volume completed successfully. Jul 10 06:51:50 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0 Jul 10 06:51:50 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e289e3d9-a714-48fe-9da4-09b96b844374 tempest-VolumesActionsTest-897391676 None] Lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:56 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0" returned: 0 in 5.886s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:56 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2237b053-ffe6-4c1a-8dbf-5a9f9b7a7578]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:56 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c Jul 10 06:51:56 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-c720bff7-7494-4c31-97e1-2d9dd29a9f64 req-1be265aa-0a39-4691-8e3c-9c24d2da7d45 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:57 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c" returned: 0 in 0.960s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:57 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:51:57 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Converted 1024.00 MB image at 173.93 MB/s Jul 10 06:51:57 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0 is being set with open permissions: ugo+rw Jul 10 06:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:57 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0 Jul 10 06:51:57 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:57 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0" returned: 0 in 0.657s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-77157689-d436-4a01-a9af-aa62d5d02fc0" released by "_copy_volume_from_snapshot" :: held 9.540s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-8be98538-7679-40ab-8b76-78779e2a2db2-77157689-d436-4a01-a9af-aa62d5d02fc0" released by "_create_volume_from_snapshot" :: held 9.581s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.605s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-c720bff7-7494-4c31-97e1-2d9dd29a9f64 req-1be265aa-0a39-4691-8e3c-9c24d2da7d45 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.893s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1329c6ab-2bfe-45b2-8a96-5a98fece23b7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-c720bff7-7494-4c31-97e1-2d9dd29a9f64 req-1be265aa-0a39-4691-8e3c-9c24d2da7d45 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f31b68-466f-4890-b479-d23aa7971f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77157689-d436-4a01-a9af-aa62d5d02fc0', 'volume_size': 1, 'snapshot_id': '8be98538-7679-40ab-8b76-78779e2a2db2'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddb53fc-7361-4dbc-8446-ab6d283eb0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:58 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Volume volume-77157689-d436-4a01-a9af-aa62d5d02fc0 (77157689-d436-4a01-a9af-aa62d5d02fc0): created successfully Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddb53fc-7361-4dbc-8446-ab6d283eb0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Flow 'volume_create_manager' (98161fa9-1925-48c6-a9e6-d999c107e423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1a05b5cd-b33b-40d4-afdd-7fab751b0dba tempest-VolumesDeleteCascade-1471084386 None] Created volume successfully. Jul 10 06:51:58 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e Jul 10 06:51:58 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-6eadcff0-fb37-4973-8918-8a37c73b2e6c-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-6eadcff0-fb37-4973-8918-8a37c73b2e6c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Performing cascade delete. {{(pid=86966) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-8be98538-7679-40ab-8b76-78779e2a2db2-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-8be98538-7679-40ab-8b76-78779e2a2db2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-quobyte-6eadcff0-fb37-4973-8918-8a37c73b2e6c" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-6eadcff0-fb37-4973-8918-8a37c73b2e6c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-quobyte-8be98538-7679-40ab-8b76-78779e2a2db2" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-8be98538-7679-40ab-8b76-78779e2a2db2" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Deleting offline snapshot 8be98538-7679-40ab-8b76-78779e2a2db2 of volume 6eadcff0-fb37-4973-8918-8a37c73b2e6c {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] snapshot_file for this snap is: volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d169b6-3fcb-4642-8e2c-bce02fef81f8]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:58 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 Jul 10 06:51:58 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:58 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-c720bff7-7494-4c31-97e1-2d9dd29a9f64 req-1be265aa-0a39-4691-8e3c-9c24d2da7d45 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e" returned: 0 in 0.831s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-c720bff7-7494-4c31-97e1-2d9dd29a9f64 req-1be265aa-0a39-4691-8e3c-9c24d2da7d45 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.849s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-c720bff7-7494-4c31-97e1-2d9dd29a9f64 req-1be265aa-0a39-4691-8e3c-9c24d2da7d45 tempest-TestInstancesWithCinderVolumes-1682914667 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '024d8151-dc48-4c61-9f21-48105c54d3cb', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:51:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-c720bff7-7494-4c31-97e1-2d9dd29a9f64 req-1be265aa-0a39-4691-8e3c-9c24d2da7d45 tempest-TestInstancesWithCinderVolumes-1682914667 None] attachment_update completed successfully. Jul 10 06:51:59 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2" returned: 0 in 0.823s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:51:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a2d87-8454-4455-8e6b-850700c0e61f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:59 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c Jul 10 06:51:59 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:00 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c" returned: 0 in 0.971s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:00 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 Jul 10 06:52:00 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:01 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2" returned: 0 in 0.809s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:01 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2 Jul 10 06:52:01 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e155b2-7fb7-4547-baa0-3c090b8cf70f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:01 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 Jul 10 06:52:01 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:01 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c.8be98538-7679-40ab-8b76-78779e2a2db2" returned: 0 in 0.711s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-8be98538-7679-40ab-8b76-78779e2a2db2" released by "_delete_snapshot" :: held 3.417s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-6eadcff0-fb37-4973-8918-8a37c73b2e6c" released by "delete_snapshot" :: held 3.464s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Created reservations ['03e61c78-829a-4c97-bbaa-bab8f64082db', '74ef1abc-b05c-43c5-994e-fa685740a198', '2ba5999e-6a55-44b8-afb7-10af13fc0fa3', '9cff68ff-b7ca-4e84-a125-a9c2efe34019'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Delete snapshot completed successfully. Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-8be98538-7679-40ab-8b76-78779e2a2db2-delete_snapshot" released by "delete_snapshot" :: held 3.648s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Snapshots deleted, issuing volume delete {{(pid=86966) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-quobyte-6eadcff0-fb37-4973-8918-8a37c73b2e6c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-6eadcff0-fb37-4973-8918-8a37c73b2e6c" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[13045f24-e707-43e4-b4f2-327c094f9b83]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:02 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249" returned: 0 in 0.884s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[628c4749-2b4f-4651-9eef-dc39624b5684]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:02 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c Jul 10 06:52:02 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:02 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 Jul 10 06:52:02 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:03 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c" returned: 0 in 0.864s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:03 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249" returned: 0 in 0.848s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.2387f662-2bd2-4be3-99c5-2bd8ae93e7f2kihb5ye2.img {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:03 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c Jul 10 06:52:03 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:03 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.2387f662-2bd2-4be3-99c5-2bd8ae93e7f2kihb5ye2.img Jul 10 06:52:03 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:03 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6eadcff0-fb37-4973-8918-8a37c73b2e6c" returned: 0 in 0.868s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-6eadcff0-fb37-4973-8918-8a37c73b2e6c" released by "delete_volume" :: held 1.834s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:04 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Created reservations ['a8b2a0cc-9ff4-41a0-9d79-d85d91f9b288', 'd5ea34e4-2903-48f9-81c9-323ffa8a51ce', 'c6fca851-8481-4255-a875-6b4509d2db85', '119e7e2b-975a-4b5a-a473-76efba715bd3'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:04 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:52:04 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-77157689-d436-4a01-a9af-aa62d5d02fc0-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-77157689-d436-4a01-a9af-aa62d5d02fc0-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "cinder-quobyte-77157689-d436-4a01-a9af-aa62d5d02fc0" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-77157689-d436-4a01-a9af-aa62d5d02fc0" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6445bff7-de97-4051-8286-7b3f65b92b98]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:05 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0 Jul 10 06:52:05 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:06 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.640s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:06 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Deleted volume successfully. Jul 10 06:52:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ca8eb6e-3ba3-43b1-aa41-a4ad96e4a0bc tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-6eadcff0-fb37-4973-8918-8a37c73b2e6c-delete_volume" released by "delete_volume" :: held 7.668s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:07 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0" returned: 0 in 1.482s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:07 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0 Jul 10 06:52:07 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-2f211c3a-e878-4a82-a375-83f52d0befdf req-1f68bfd7-f75d-417f-958a-bfe7eb1a844a tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:08 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77157689-d436-4a01-a9af-aa62d5d02fc0" returned: 0 in 1.329s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-quobyte-77157689-d436-4a01-a9af-aa62d5d02fc0" released by "delete_volume" :: held 2.926s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:08 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.2387f662-2bd2-4be3-99c5-2bd8ae93e7f2kihb5ye2.img" returned: 0 in 5.391s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4724dd88-5644-4967-969f-128a24cafb74]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Created reservations ['bdf9369c-0748-4d8a-9755-6cfe2c01eeb6', '4bbc1049-fdea-4213-bc03-9c55e97a49cd', '155e6323-247a-4f79-921a-d9a1757ec84f', 'd49dd941-0d54-4dc1-aa93-9e1844360221'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:08 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 Jul 10 06:52:08 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:08 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:52:08 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:09 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.664s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:09 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Deleted volume successfully. Jul 10 06:52:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-58b92e9b-8d99-40a4-a69a-277e19c88348 tempest-VolumesDeleteCascade-1471084386 None] Lock "cinder-77157689-d436-4a01-a9af-aa62d5d02fc0-delete_volume" released by "delete_volume" :: held 3.924s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:09 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249" returned: 0 in 0.979s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:09 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.2387f662-2bd2-4be3-99c5-2bd8ae93e7f2kihb5ye2.img {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:52:09 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] Converted 1024.00 MB image at 189.90 MB/s Jul 10 06:52:09 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] 2387f662-2bd2-4be3-99c5-2bd8ae93e7f2 was raw, no need to convert to raw {{(pid=86966) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 10 06:52:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:52:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:11 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:52:11 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:12 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.767s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:52:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:52:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Flow 'volume_create_manager' (16104663-4f0e-408a-ba73-c385de4c6d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67551016-a070-4079-b7a2-a831955c7a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67551016-a070-4079-b7a2-a831955c7a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1006560581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dd2f72-1181-468e-bb4c-2d9c19b37f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91eccc6d3bf14f6e83919e8f51ec46e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:14Z,use_quota=True,user_id='940dd48a3b2f41c7bbe673f275daf340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e8a893-ae8e-4771-a9f5-cf36746dac63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e8a893-ae8e-4771-a9f5-cf36746dac63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be89b40b-4dc8-495a-a28a-f2e54bc77c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be89b40b-4dc8-495a-a28a-f2e54bc77c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9dd2f72-1181-468e-bb4c-2d9c19b37f08', 'volume_name': 'volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0533f730-eb23-4b83-b6e9-fd83bce556cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0533f730-eb23-4b83-b6e9-fd83bce556cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acdfd00-8276-4e2a-be56-13add07b2ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Volume f9dd2f72-1181-468e-bb4c-2d9c19b37f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08', 'volume_size': 1} Jul 10 06:52:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:23 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=56,cinder:SELECT=57,cinder:INSERT=15,cinder:DELETE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:52:23 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=52,cinder:SELECT=55,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:52:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.305s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] Uploaded volume to glance image-id: 2387f662-2bd2-4be3-99c5-2bd8ae93e7f2. {{(pid=86966) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 06:52:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-2f211c3a-e878-4a82-a375-83f52d0befdf req-1f68bfd7-f75d-417f-958a-bfe7eb1a844a tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.129s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[711c4f40-8c94-46ac-bd0d-e7b5f49ce227]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-2f211c3a-e878-4a82-a375-83f52d0befdf req-1f68bfd7-f75d-417f-958a-bfe7eb1a844a tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f48d2d33-5898-4f56-97c1-4db7225417e4 tempest-VolumesActionsTest-897391676 None] Copy volume to image completed successfully. Jul 10 06:52:28 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 Jul 10 06:52:28 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:29 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-2f211c3a-e878-4a82-a375-83f52d0befdf req-1f68bfd7-f75d-417f-958a-bfe7eb1a844a tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41" returned: 0 in 0.746s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-2f211c3a-e878-4a82-a375-83f52d0befdf req-1f68bfd7-f75d-417f-958a-bfe7eb1a844a tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.763s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.528s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1006560581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dd2f72-1181-468e-bb4c-2d9c19b37f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91eccc6d3bf14f6e83919e8f51ec46e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:14Z,use_quota=True,user_id='940dd48a3b2f41c7bbe673f275daf340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Creating volume f9dd2f72-1181-468e-bb4c-2d9c19b37f08 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:52:29 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:29 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08 1073741824 Jul 10 06:52:29 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-2f211c3a-e878-4a82-a375-83f52d0befdf req-1f68bfd7-f75d-417f-958a-bfe7eb1a844a tempest-TestInstancesWithCinderVolumes-1682914667 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac4d8bef-a321-4248-9721-312489ed5d8d', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:52:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-2f211c3a-e878-4a82-a375-83f52d0befdf req-1f68bfd7-f75d-417f-958a-bfe7eb1a844a tempest-TestInstancesWithCinderVolumes-1682914667 None] attachment_update completed successfully. Jul 10 06:52:30 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08 1073741824" returned: 0 in 0.936s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:30 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08 Jul 10 06:52:30 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:31 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08" returned: 0 in 0.648s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.691s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acdfd00-8276-4e2a-be56-13add07b2ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fab4f3-0f78-4abf-b823-248c108f8f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[059c1f17-ea32-4418-bce9-4889495e4ffb]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:31 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Volume volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08 (f9dd2f72-1181-468e-bb4c-2d9c19b37f08): created successfully Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fab4f3-0f78-4abf-b823-248c108f8f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Flow 'volume_create_manager' (16104663-4f0e-408a-ba73-c385de4c6d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a7678c5b-c5cb-4485-8b82-2226a6dfa215 tempest-VolumesTransfersTest-1197203034 None] Created volume successfully. Jul 10 06:52:31 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 Jul 10 06:52:31 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8fea075f-f85a-4371-9cef-d6197b11250a tempest-VolumesTransfersTest-1648777599 None] Transfer volume completed successfully. Jul 10 06:52:31 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249" returned: 0 in 0.837s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[204a4d07-f43e-4b10-9d3f-53e69e7acc9b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:32 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 Jul 10 06:52:32 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:32 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249" returned: 0 in 0.769s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:32 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img Jul 10 06:52:32 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Acquiring lock "cinder-f9dd2f72-1181-468e-bb4c-2d9c19b37f08-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Lock "cinder-f9dd2f72-1181-468e-bb4c-2d9c19b37f08-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Acquiring lock "cinder-quobyte-f9dd2f72-1181-468e-bb4c-2d9c19b37f08" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Lock "cinder-quobyte-f9dd2f72-1181-468e-bb4c-2d9c19b37f08" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3851a5a-c77e-429a-9d2e-81874d245ee4]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:33 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08 Jul 10 06:52:33 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:34 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08" returned: 0 in 1.380s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:34 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08 Jul 10 06:52:34 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:35 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f9dd2f72-1181-468e-bb4c-2d9c19b37f08" returned: 0 in 1.281s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Lock "cinder-quobyte-f9dd2f72-1181-468e-bb4c-2d9c19b37f08" released by "delete_volume" :: held 2.738s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:35 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Created reservations ['87d24778-71fe-451e-9b0d-80eb0a6b4604', 'f57e7881-9290-45f2-86cb-aa85dbc58199', '94b5fc11-c876-48a6-b1fc-19409ee79706', '902d9316-9748-498a-b96a-44a7ebf8e7bb'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:36 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:52:36 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:37 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:52:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Flow 'volume_create_manager' (d8f2c181-7d1e-4266-b59a-0689c4e4fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a998519-432e-4624-8b32-2f4c77e0c79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:37 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a998519-432e-4624-8b32-2f4c77e0c79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-972720478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fd749e-2461-45ac-9bf6-e01047196934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91eccc6d3bf14f6e83919e8f51ec46e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:38Z,use_quota=True,user_id='940dd48a3b2f41c7bbe673f275daf340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a469d5-6404-41b0-8fb4-1f500aa4fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a469d5-6404-41b0-8fb4-1f500aa4fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8314248d-6577-4860-947c-1ea2b4cfefa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8314248d-6577-4860-947c-1ea2b4cfefa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fd749e-2461-45ac-9bf6-e01047196934', 'volume_name': 'volume-79fd749e-2461-45ac-9bf6-e01047196934', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f1eca5-d398-4993-b5b1-efe08d5c3114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f1eca5-d398-4993-b5b1-efe08d5c3114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b8f1cb-2158-4d28-8d26-7b40b857f920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:38 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Volume 79fd749e-2461-45ac-9bf6-e01047196934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fd749e-2461-45ac-9bf6-e01047196934', 'volume_size': 1} Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.975s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Deleted volume successfully. Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fa2cb962-f8b0-4589-8bee-48bb4f45a77f tempest-VolumesTransfersTest-95864520 None] Lock "cinder-f9dd2f72-1181-468e-bb4c-2d9c19b37f08-delete_volume" released by "delete_volume" :: held 5.220s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:38 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img" returned: 0 in 5.730s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2adbc2-6586-47ee-be02-59b9815a3e8f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:38 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 Jul 10 06:52:38 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:39 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249" returned: 0 in 0.935s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:39 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:52:39 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Converted 1024.00 MB image at 178.68 MB/s Jul 10 06:52:39 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] 97f9429b-2d6b-4fa6-81c1-680f484f1711 was raw, converting to qcow2 {{(pid=86966) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 10 06:52:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac4d69-5646-4537-a5b9-5396c4029105]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:39 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img Jul 10 06:52:39 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:40 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img" returned: 0 in 0.755s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:40 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img Jul 10 06:52:40 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-b2c83564-b4c3-4d7d-bc2e-1e7e1e3c3eeb req-74ad5a42-4ed8-43f1-8432-eaa2d2f220cb tempest-TestInstancesWithCinderVolumes-1682914667 None] Terminate volume connection completed successfully. Jul 10 06:52:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-b2c83564-b4c3-4d7d-bc2e-1e7e1e3c3eeb req-74ad5a42-4ed8-43f1-8432-eaa2d2f220cb tempest-TestInstancesWithCinderVolumes-1682914667 None] Deleting attachment 024d8151-dc48-4c61-9f21-48105c54d3cb. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:52:40 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img" returned: 1 in 0.784s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:52:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img /opt/stack/data/cinder/conversion/vol_upload_sabnt63s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:40 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img /opt/stack/data/cinder/conversion/vol_upload_sabnt63s Jul 10 06:52:40 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:41 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img /opt/stack/data/cinder/conversion/vol_upload_sabnt63s" returned: 0 in 0.714s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:41 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Image conversion details: src /opt/stack/data/cinder/conversion/217c19e5-2ced-478b-b5d0-de9df2b0e249.temp_image.97f9429b-2d6b-4fa6-81c1-680f484f1711xattk47g.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_sabnt63s {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:52:41 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 06:52:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a69f87b-a35a-4822-85f7-09f7f195eea1]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sabnt63s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:41 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sabnt63s Jul 10 06:52:41 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:42 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sabnt63s" returned: 0 in 0.730s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "cinder-f7f5c0d4-2e3b-4840-8b2d-0360d055931e-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-f7f5c0d4-2e3b-4840-8b2d-0360d055931e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "cinder-quobyte-f7f5c0d4-2e3b-4840-8b2d-0360d055931e" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-quobyte-f7f5c0d4-2e3b-4840-8b2d-0360d055931e" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:42 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[66506a33-51f5-4ceb-bb74-d51353d04841]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:43 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e Jul 10 06:52:43 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:43 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e" returned: 0 in 0.961s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:43 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e Jul 10 06:52:43 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.897s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Uploaded volume to glance image-id: 97f9429b-2d6b-4fa6-81c1-680f484f1711. {{(pid=86966) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.932s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-972720478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fd749e-2461-45ac-9bf6-e01047196934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91eccc6d3bf14f6e83919e8f51ec46e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:38Z,use_quota=True,user_id='940dd48a3b2f41c7bbe673f275daf340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Creating volume 79fd749e-2461-45ac-9bf6-e01047196934 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:52:43 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:52:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f067b267-19cc-41fa-8c5d-abd38eaf2950 tempest-VolumesActionsTest-897391676 None] Copy volume to image completed successfully. Jul 10 06:52:44 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934 1073741824 Jul 10 06:52:44 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:44 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f7f5c0d4-2e3b-4840-8b2d-0360d055931e" returned: 0 in 0.822s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-quobyte-f7f5c0d4-2e3b-4840-8b2d-0360d055931e" released by "delete_volume" :: held 1.830s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:44 devstack cinder-volume[86966]: WARNING cinder.quota [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-88333379-54586789 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-88333379-54586789, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:52:44 devstack cinder-volume[86966]: WARNING cinder.quota [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-88333379-54586789 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-88333379-54586789, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:52:44 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Created reservations ['9947b65b-57b3-4df2-a9f2-4dd08d425359', 'ccbda330-cd99-4f1c-a7e8-261d9238d7cd', '963a21ed-490e-49d5-b7ae-56f7650d6518', 'b87daee9-321e-4c4e-a55c-5ca96763a7ed'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:44 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:52:44 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Acquiring lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:45 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934 1073741824" returned: 0 in 1.052s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Acquiring lock "cinder-quobyte-217c19e5-2ced-478b-b5d0-de9df2b0e249" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Lock "cinder-quobyte-217c19e5-2ced-478b-b5d0-de9df2b0e249" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f80c992-3817-4246-97fc-e8d4b6947cfd]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:45 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934 Jul 10 06:52:45 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:45 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 Jul 10 06:52:45 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:45 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.865s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Deleted volume successfully. Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2521fc5b-0864-4523-ab77-e97b28498b98 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-f7f5c0d4-2e3b-4840-8b2d-0360d055931e-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:45 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b8f1cb-2158-4d28-8d26-7b40b857f920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fd749e-2461-45ac-9bf6-e01047196934', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd2cea9-9632-458e-b751-22952854fd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Volume volume-79fd749e-2461-45ac-9bf6-e01047196934 (79fd749e-2461-45ac-9bf6-e01047196934): created successfully Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd2cea9-9632-458e-b751-22952854fd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Flow 'volume_create_manager' (d8f2c181-7d1e-4266-b59a-0689c4e4fa40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f6d84b1b-e5a9-4c23-852d-b1058f0f89d7 tempest-VolumesTransfersTest-1197203034 None] Created volume successfully. Jul 10 06:52:45 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:45 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249 Jul 10 06:52:45 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:46 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-217c19e5-2ced-478b-b5d0-de9df2b0e249" returned: 0 in 0.675s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Lock "cinder-quobyte-217c19e5-2ced-478b-b5d0-de9df2b0e249" released by "delete_volume" :: held 1.594s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Created reservations ['184494d7-bbd0-4756-848b-f64e5944857a', '197e0f20-c4f9-483b-894b-9d6858412ebd', '40c15a8a-e572-4580-aa6f-167d26052d8f', '2df2f7b4-682e-40ba-a2ba-53a5f75fac3a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Acquiring lock "cinder-79fd749e-2461-45ac-9bf6-e01047196934-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Lock "cinder-79fd749e-2461-45ac-9bf6-e01047196934-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:46 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:52:46 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Acquiring lock "cinder-quobyte-79fd749e-2461-45ac-9bf6-e01047196934" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Lock "cinder-quobyte-79fd749e-2461-45ac-9bf6-e01047196934" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[719deafc-5c65-4e2a-a8cd-d1ea23125fe7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:47 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934 Jul 10 06:52:47 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:47 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.714s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:47 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Deleted volume successfully. Jul 10 06:52:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-002aeb9d-cf18-438d-b2aa-7ae5ec6e1868 tempest-VolumesActionsTest-897391676 None] Lock "cinder-217c19e5-2ced-478b-b5d0-de9df2b0e249-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:47 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934" returned: 0 in 1.016s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:48 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934 Jul 10 06:52:48 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-9533fdc9-c440-46cc-baff-2c999b5b2978 req-0b5bb97a-4a60-4cdc-913c-b9f44a1e7ae0 tempest-TestInstancesWithCinderVolumes-1682914667 None] Terminate volume connection completed successfully. Jul 10 06:52:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-9533fdc9-c440-46cc-baff-2c999b5b2978 req-0b5bb97a-4a60-4cdc-913c-b9f44a1e7ae0 tempest-TestInstancesWithCinderVolumes-1682914667 None] Deleting attachment ac4d8bef-a321-4248-9721-312489ed5d8d. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:52:48 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-79fd749e-2461-45ac-9bf6-e01047196934" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Lock "cinder-quobyte-79fd749e-2461-45ac-9bf6-e01047196934" released by "delete_volume" :: held 1.838s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:48 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Created reservations ['03b79392-6ac3-46c7-b322-3c335014a6da', '327c232f-22e4-40ac-9490-5a29fd2c86bf', 'b59334fa-6a6b-4ba4-be5d-cfa91cabf6a5', 'e3bcc9b6-bc54-4de5-a632-72dce7085735'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:48 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:52:48 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:49 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.712s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:49 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Deleted volume successfully. Jul 10 06:52:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a62f598a-e34d-48ca-a998-50a67a829541 tempest-VolumesTransfersTest-95864520 None] Lock "cinder-79fd749e-2461-45ac-9bf6-e01047196934-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "cinder-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "cinder-quobyte-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-quobyte-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae179b2b-339c-4ca2-8134-7be663a9179f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:50 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 Jul 10 06:52:50 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:51 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41" returned: 0 in 0.952s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:51 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41 Jul 10 06:52:51 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:52 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41" returned: 0 in 0.892s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-quobyte-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41" released by "delete_volume" :: held 1.943s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:52 devstack cinder-volume[86966]: WARNING cinder.quota [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-286524916-657926952 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-286524916-657926952, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:52:52 devstack cinder-volume[86966]: WARNING cinder.quota [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-286524916-657926952 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-286524916-657926952, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:52:52 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Created reservations ['4132b6cb-2d07-4918-b62a-f832aeeeb3e4', '3e6dc58f-8677-4c22-a15e-560f5059d63d', 'ba470bc6-59d3-4eec-9b52-c2557e8f5316', 'f42f2fb7-9732-4b6d-b8fe-08a483c19b10'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:52 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:52:52 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:53 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.026s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:53 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Deleted volume successfully. Jul 10 06:52:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0451e0e0-6846-4d79-9e7a-8ccf44208eb9 tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-1d8b5cf7-6e97-4483-9e9e-64b8e1d5be41-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Flow 'volume_create_manager' (68c4f1fd-9934-4332-980e-3953b44ef197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785316a8-56de-4803-ae2f-a60d3bae77d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785316a8-56de-4803-ae2f-a60d3bae77d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1049906094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20e23a8-15c5-47bd-a1d1-1cc0a974c132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206d690973a6408b8ffbc71dc626bc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:55Z,use_quota=True,user_id='663c62ce6d454abdae98166fb66e8e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ac706d-9a34-490e-b484-7915484623c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ac706d-9a34-490e-b484-7915484623c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8b5cea-aac0-4684-b7f8-dfd04255ab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8b5cea-aac0-4684-b7f8-dfd04255ab47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c20e23a8-15c5-47bd-a1d1-1cc0a974c132', 'volume_name': 'volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fb60c4-2e22-449b-823a-6684b9429560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9fb60c4-2e22-449b-823a-6684b9429560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f656563-3fe8-4531-a0ea-266188cee019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:54 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Volume c20e23a8-15c5-47bd-a1d1-1cc0a974c132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132', 'volume_size': 1} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1049906094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20e23a8-15c5-47bd-a1d1-1cc0a974c132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206d690973a6408b8ffbc71dc626bc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:55Z,use_quota=True,user_id='663c62ce6d454abdae98166fb66e8e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Creating volume c20e23a8-15c5-47bd-a1d1-1cc0a974c132 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:52:54 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:52:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:54 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 1073741824 Jul 10 06:52:54 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:55 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 1073741824" returned: 0 in 0.999s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:55 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 Jul 10 06:52:55 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:56 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132" returned: 0 in 0.921s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:52:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f656563-3fe8-4531-a0ea-266188cee019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157bfdbc-6ddb-45c8-8397-38b1b542a2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:56 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Volume volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 (c20e23a8-15c5-47bd-a1d1-1cc0a974c132): created successfully Jul 10 06:52:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157bfdbc-6ddb-45c8-8397-38b1b542a2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Flow 'volume_create_manager' (68c4f1fd-9934-4332-980e-3953b44ef197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5b59fbba-fa2c-4240-93f2-d71f113efdaf tempest-VolumesCloneTest-1259514457 None] Created volume successfully. Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Flow 'volume_create_manager' (5f2ce5fc-fb25-40f1-9d81-37f52d49b6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2422a0b-21df-4c71-a0ae-179eebc8bd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2422a0b-21df-4c71-a0ae-179eebc8bd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-124367377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f14135-67e1-41d7-9c90-dce8807d82f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923b735e830b4c53bac059d80b360111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:58Z,use_quota=True,user_id='9b6bf3e63bc74f21a8f42bea98afdb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713331b3-9a28-436d-a75a-6b08689b392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713331b3-9a28-436d-a75a-6b08689b392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eface3d5-09a6-435b-8d74-cf746a2a0921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eface3d5-09a6-435b-8d74-cf746a2a0921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f14135-67e1-41d7-9c90-dce8807d82f3', 'volume_name': 'volume-a7f14135-67e1-41d7-9c90-dce8807d82f3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c90869-ac75-4c16-a93e-55b985c55b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c90869-ac75-4c16-a93e-55b985c55b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfa9606-aa17-403a-9480-86a936242475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:58 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Volume a7f14135-67e1-41d7-9c90-dce8807d82f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f14135-67e1-41d7-9c90-dce8807d82f3', 'volume_size': 1} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-124367377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f14135-67e1-41d7-9c90-dce8807d82f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923b735e830b4c53bac059d80b360111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:58Z,use_quota=True,user_id='9b6bf3e63bc74f21a8f42bea98afdb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Creating volume a7f14135-67e1-41d7-9c90-dce8807d82f3 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:52:58 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:58 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3 1073741824 Jul 10 06:52:58 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-af1cf345-b8cf-43b7-a8d4-e85d9ebab981 req-ac4c0997-44d6-470b-841f-aab83e62f233 tempest-TestInstancesWithCinderVolumes-1682914667 None] Terminate volume connection completed successfully. Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-af1cf345-b8cf-43b7-a8d4-e85d9ebab981 req-ac4c0997-44d6-470b-841f-aab83e62f233 tempest-TestInstancesWithCinderVolumes-1682914667 None] Deleting attachment bcb34f8d-dfed-4d0a-9ab6-0170ccd125ea. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Flow 'volume_create_manager' (6f4d2d3e-8478-4867-9184-5129e5f88ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8247c49e-4403-4251-b6e6-4da8615c2700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8247c49e-4403-4251-b6e6-4da8615c2700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-490773951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb315883-cfc4-4541-9171-535f68d8677d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206d690973a6408b8ffbc71dc626bc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c20e23a8-15c5-47bd-a1d1-1cc0a974c132,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:58Z,use_quota=True,user_id='663c62ce6d454abdae98166fb66e8e87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed52b96-a246-4c91-829c-3a788a0bbb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed52b96-a246-4c91-829c-3a788a0bbb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d57ced-9243-4c9b-92f5-c25993e8a857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7d57ced-9243-4c9b-92f5-c25993e8a857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cb315883-cfc4-4541-9171-535f68d8677d', 'volume_name': 'volume-cb315883-cfc4-4541-9171-535f68d8677d', 'volume_size': 2, 'source_volid': 'c20e23a8-15c5-47bd-a1d1-1cc0a974c132', 'source_volstatus': 'available'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b146acc9-2d64-4e75-817c-29b3776f259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b146acc9-2d64-4e75-817c-29b3776f259a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0752d82a-4f38-402c-b34e-aa746a3fd862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:58 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Volume cb315883-cfc4-4541-9171-535f68d8677d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cb315883-cfc4-4541-9171-535f68d8677d', 'volume_size': 2, 'source_volid': 'c20e23a8-15c5-47bd-a1d1-1cc0a974c132', 'source_volstatus': 'available'} Jul 10 06:52:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:59 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3 1073741824" returned: 0 in 0.859s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:59 devstack sudo[99004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3 Jul 10 06:52:59 devstack sudo[99004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:59 devstack sudo[99004]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3" returned: 0 in 0.644s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.336s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:00 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Cloning volume c20e23a8-15c5-47bd-a1d1-1cc0a974c132 to volume cb315883-cfc4-4541-9171-535f68d8677d Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfa9606-aa17-403a-9480-86a936242475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f14135-67e1-41d7-9c90-dce8807d82f3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626fc868-accb-40a1-bf08-11fb914c2a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:00 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Volume volume-a7f14135-67e1-41d7-9c90-dce8807d82f3 (a7f14135-67e1-41d7-9c90-dce8807d82f3): created successfully Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626fc868-accb-40a1-bf08-11fb914c2a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Flow 'volume_create_manager' (5f2ce5fc-fb25-40f1-9d81-37f52d49b6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Creating offline snapshot 7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 of volume c20e23a8-15c5-47bd-a1d1-1cc0a974c132 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:53:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dfdcc60b-4862-42d4-8f93-39cded6e5b80 tempest-VolumesTransfersV355Test-949804575 None] Created volume successfully. Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0a0dd3-0f0c-4999-977a-a15fd2af9ab1]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:00 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 Jul 10 06:53:00 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:00 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132" returned: 0 in 0.798s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:00 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 1G Jul 10 06:53:00 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-145707be-13da-424a-9b39-59de51596ff0 tempest-VolumesTransfersV355Test-13386030 None] Transfer volume completed successfully. Jul 10 06:53:01 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 1G" returned: 0 in 0.944s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "cinder-585c6ce8-0270-429c-8158-8f5e13e47717-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:01 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 Jul 10 06:53:01 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-585c6ce8-0270-429c-8158-8f5e13e47717-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "cinder-quobyte-585c6ce8-0270-429c-8158-8f5e13e47717" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-quobyte-585c6ce8-0270-429c-8158-8f5e13e47717" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Acquiring lock "cinder-a7f14135-67e1-41d7-9c90-dce8807d82f3-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Lock "cinder-a7f14135-67e1-41d7-9c90-dce8807d82f3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a353513-5337-4057-9b00-651c09361a58]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Acquiring lock "cinder-quobyte-a7f14135-67e1-41d7-9c90-dce8807d82f3" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Lock "cinder-quobyte-a7f14135-67e1-41d7-9c90-dce8807d82f3" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae68d7e-88a3-4938-8141-d3bbd5c29dcc]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:02 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 Jul 10 06:53:02 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:02 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3 Jul 10 06:53:02 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:02 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6" returned: 0 in 0.761s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:02 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 is being set with open permissions: ugo+rw Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:02 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 Jul 10 06:53:02 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:02 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717" returned: 0 in 0.814s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:02 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 Jul 10 06:53:02 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:02 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3" returned: 0 in 0.855s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:03 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3 Jul 10 06:53:03 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:03 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6" returned: 0 in 0.690s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:03 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.info Jul 10 06:53:03 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:03 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717" returned: 1 in 0.770s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:03 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717 Jul 10 06:53:03 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:03 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a7f14135-67e1-41d7-9c90-dce8807d82f3" returned: 0 in 0.742s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Lock "cinder-quobyte-a7f14135-67e1-41d7-9c90-dce8807d82f3" released by "delete_volume" :: held 1.649s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Created reservations ['bd848919-0cdd-418d-8119-97b8c367a28b', 'e060034b-ff40-4931-93d4-5a7da42d28f6', 'd214f027-22dc-4dcb-96c4-f5a6b2251e3c', 'f1e08e1a-e17a-458c-9acf-fe9e1bdfd340'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:03 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:53:03 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:04 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.info" returned: 0 in 0.723s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:04 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.info is being set with open permissions: ugo+rw Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:04 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.info Jul 10 06:53:04 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:04 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-585c6ce8-0270-429c-8158-8f5e13e47717" returned: 0 in 0.744s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-quobyte-585c6ce8-0270-429c-8158-8f5e13e47717" released by "delete_volume" :: held 2.427s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:04 devstack cinder-volume[86966]: WARNING cinder.quota [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1730252894-1173304907 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1730252894-1173304907, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:53:04 devstack cinder-volume[86966]: WARNING cinder.quota [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1730252894-1173304907 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1730252894-1173304907, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Created reservations ['da10cad0-3de1-4466-be6e-350304811da2', '984cde5f-e0d1-4fd8-b61b-bac7e761ffb2', '91572661-77e3-475d-bc4c-5f80ef944212', '2316faa5-67f1-4582-9a80-1221747bc4a8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:04 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.712s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Deleted volume successfully. Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:04 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:53:04 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eb5487e9-569e-4c08-bb63-79d9cba5408c tempest-VolumesTransfersV355Test-35737975 None] Lock "cinder-a7f14135-67e1-41d7-9c90-dce8807d82f3-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Flow 'volume_create_manager' (790853a8-3d75-4f65-a392-1dc6af28e363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb640f7-f4b9-416f-9f24-91fad6ec2a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:04 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb640f7-f4b9-416f-9f24-91fad6ec2a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1415044225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8774febe-ad7c-45f9-bfee-a4c05d79a18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923b735e830b4c53bac059d80b360111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:05Z,use_quota=True,user_id='9b6bf3e63bc74f21a8f42bea98afdb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea921705-3fe7-4eae-996b-f42ab4519e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea921705-3fe7-4eae-996b-f42ab4519e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84997723-52d9-4ba2-9efa-84a495db41e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84997723-52d9-4ba2-9efa-84a495db41e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8774febe-ad7c-45f9-bfee-a4c05d79a18e', 'volume_name': 'volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022e61f2-3a09-4f5e-8113-6d70e4239239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022e61f2-3a09-4f5e-8113-6d70e4239239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa1a9e9-7a84-49f7-9d02-fdeef5092529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Volume 8774febe-ad7c-45f9-bfee-a4c05d79a18e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e', 'volume_size': 1} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.info" returned: 0 in 0.865s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Acquiring lock "cinder-quobyte-cb315883-cfc4-4541-9171-535f68d8677d" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Lock "cinder-quobyte-cb315883-cfc4-4541-9171-535f68d8677d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] snapshot: 7c0b1b8b-f0e0-4150-8416-02d4edfe4da6, volume: cb315883-cfc4-4541-9171-535f68d8677d, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[834212ac-3466-4a29-b45b-34bd84940671]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:05 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 Jul 10 06:53:05 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:05 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.671s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:05 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Deleted volume successfully. Jul 10 06:53:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-13f78399-6590-4a89-b300-5d6f56d3264a tempest-TestInstancesWithCinderVolumes-1682914667 None] Lock "cinder-585c6ce8-0270-429c-8158-8f5e13e47717-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:05 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6" returned: 0 in 0.810s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:53:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:53:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:53:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcf8ef7-ae9e-453c-8255-08c479861ef9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:05 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 Jul 10 06:53:05 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:06 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132" returned: 0 in 0.816s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:06 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:53:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:06 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d Jul 10 06:53:06 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:53:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:11 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:53:11 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:12 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d" returned: 0 in 5.579s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c508896-b3c9-43b4-94ae-0a616bb90a50]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:12 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 Jul 10 06:53:12 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:12 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.071s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:53:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:53:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:53:13 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132" returned: 0 in 1.133s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:13 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:53:13 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Converted 1024.00 MB image at 183.43 MB/s Jul 10 06:53:13 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d is being set with open permissions: ugo+rw Jul 10 06:53:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:13 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d Jul 10 06:53:13 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:14 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d" returned: 0 in 0.726s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Lock "cinder-quobyte-cb315883-cfc4-4541-9171-535f68d8677d" released by "_copy_volume_from_snapshot" :: held 9.150s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Acquiring lock "cinder-quobyte-7c0b1b8b-f0e0-4150-8416-02d4edfe4da6" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Lock "cinder-quobyte-7c0b1b8b-f0e0-4150-8416-02d4edfe4da6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Deleting offline snapshot 7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 of volume c20e23a8-15c5-47bd-a1d1-1cc0a974c132 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:53:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] snapshot_file for this snap is: volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:53:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[05557327-eb9d-4277-9837-d2e3147b23f5]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:14 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 Jul 10 06:53:14 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:15 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6" returned: 0 in 0.894s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:53:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6385b252-c5b9-44af-8e30-bb5776a8eced]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:15 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 Jul 10 06:53:15 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:15 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=57,cinder:UPDATE=68,cinder:INSERT=19,cinder:DELETE=8 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:53:15 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:15 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 Jul 10 06:53:15 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:16 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6" returned: 0 in 0.836s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:16 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6 Jul 10 06:53:16 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:17 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132.7c0b1b8b-f0e0-4150-8416-02d4edfe4da6" returned: 0 in 0.690s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Lock "cinder-quobyte-7c0b1b8b-f0e0-4150-8416-02d4edfe4da6" released by "_delete_snapshot" :: held 3.329s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.526s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.633s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1415044225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8774febe-ad7c-45f9-bfee-a4c05d79a18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923b735e830b4c53bac059d80b360111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:05Z,use_quota=True,user_id='9b6bf3e63bc74f21a8f42bea98afdb5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Creating volume 8774febe-ad7c-45f9-bfee-a4c05d79a18e {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:17 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:17 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e 1073741824 Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0752d82a-4f38-402c-b34e-aa746a3fd862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb315883-cfc4-4541-9171-535f68d8677d', 'volume_size': 2, 'source_volid': 'c20e23a8-15c5-47bd-a1d1-1cc0a974c132', 'source_volstatus': 'available'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:17 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500e987a-2ef2-43f5-9d99-98be4dae1f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:17 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Volume volume-cb315883-cfc4-4541-9171-535f68d8677d (cb315883-cfc4-4541-9171-535f68d8677d): created successfully Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500e987a-2ef2-43f5-9d99-98be4dae1f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Flow 'volume_create_manager' (6f4d2d3e-8478-4867-9184-5129e5f88ea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ffcf359e-bea2-4598-9896-145b60c19d64 tempest-VolumesCloneTest-1259514457 None] Created volume successfully. Jul 10 06:53:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Acquiring lock "cinder-cb315883-cfc4-4541-9171-535f68d8677d-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Lock "cinder-cb315883-cfc4-4541-9171-535f68d8677d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Acquiring lock "cinder-quobyte-cb315883-cfc4-4541-9171-535f68d8677d" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Lock "cinder-quobyte-cb315883-cfc4-4541-9171-535f68d8677d" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[41929b64-450d-4c58-ac8e-cfa9acb8aaf1]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:18 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d Jul 10 06:53:18 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:18 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e 1073741824" returned: 0 in 0.978s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:18 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e Jul 10 06:53:18 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:19 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d" returned: 0 in 0.820s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:19 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d Jul 10 06:53:19 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:19 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e" returned: 0 in 0.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa1a9e9-7a84-49f7-9d02-fdeef5092529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb96fb73-959e-4982-8c32-95f8857dd15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:19 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Volume volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e (8774febe-ad7c-45f9-bfee-a4c05d79a18e): created successfully Jul 10 06:53:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb96fb73-959e-4982-8c32-95f8857dd15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Flow 'volume_create_manager' (790853a8-3d75-4f65-a392-1dc6af28e363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a2312b36-b9f4-4277-a1f2-800c537924bc tempest-VolumesTransfersV355Test-949804575 None] Created volume successfully. Jul 10 06:53:19 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cb315883-cfc4-4541-9171-535f68d8677d" returned: 0 in 0.761s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Lock "cinder-quobyte-cb315883-cfc4-4541-9171-535f68d8677d" released by "delete_volume" :: held 1.634s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Created reservations ['b2936cb9-d4b2-4782-b16e-d20baa4d6d55', '0f9939fc-063f-4820-8fa1-8ea08c64b222', '11acf41c-0496-460e-89f7-9f8133144b1c', '406ab0cb-9e5f-4884-babc-d4d5972013cf'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:20 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:53:20 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Acquiring lock "cinder-8774febe-ad7c-45f9-bfee-a4c05d79a18e-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Lock "cinder-8774febe-ad7c-45f9-bfee-a4c05d79a18e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Acquiring lock "cinder-quobyte-8774febe-ad7c-45f9-bfee-a4c05d79a18e" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Lock "cinder-quobyte-8774febe-ad7c-45f9-bfee-a4c05d79a18e" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e4ee4a-e747-4eb7-9959-dc1747a47012]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Acquiring lock "cinder-c20e23a8-15c5-47bd-a1d1-1cc0a974c132-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Lock "cinder-c20e23a8-15c5-47bd-a1d1-1cc0a974c132-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Acquiring lock "cinder-quobyte-c20e23a8-15c5-47bd-a1d1-1cc0a974c132" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Lock "cinder-quobyte-c20e23a8-15c5-47bd-a1d1-1cc0a974c132" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:20 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e Jul 10 06:53:20 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56a0caa-fccd-4078-b3d3-811fba541374]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:20 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 Jul 10 06:53:20 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:21 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.915s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:21 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Deleted volume successfully. Jul 10 06:53:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-234f2e31-8398-40f0-8687-bb0d6daa9aba tempest-VolumesCloneTest-1259514457 None] Lock "cinder-cb315883-cfc4-4541-9171-535f68d8677d-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:21 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e" returned: 0 in 0.880s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:21 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e Jul 10 06:53:21 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:21 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132" returned: 0 in 0.880s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:21 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132 Jul 10 06:53:21 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:22 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8774febe-ad7c-45f9-bfee-a4c05d79a18e" returned: 0 in 0.771s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Lock "cinder-quobyte-8774febe-ad7c-45f9-bfee-a4c05d79a18e" released by "delete_volume" :: held 1.729s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:22 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c20e23a8-15c5-47bd-a1d1-1cc0a974c132" returned: 0 in 0.710s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Created reservations ['c73e49fb-d956-446c-890c-93a39b3a25b3', '60748472-3681-44c7-a064-85d902145769', '12d5f0b7-b032-40bd-977a-19612e1f06d6', '9e04fdf7-1492-49d8-98ad-d02fd208d795'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Lock "cinder-quobyte-c20e23a8-15c5-47bd-a1d1-1cc0a974c132" released by "delete_volume" :: held 1.680s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Created reservations ['4ca10331-91ff-4020-811b-24e8fd094178', '3f481b55-91b6-4154-ba59-95f56cac0c27', 'ae654d39-8ee7-4c07-8c62-461ac15a69bf', '3b204d54-d95e-4665-b5f5-e8d463bc728b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:22 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:53:22 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:22 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:53:22 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:23 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.909s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:23 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Deleted volume successfully. Jul 10 06:53:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-33e2aa04-b142-4651-ade9-8905dcc4cef0 tempest-VolumesCloneTest-1259514457 None] Lock "cinder-c20e23a8-15c5-47bd-a1d1-1cc0a974c132-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:23 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.132s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:23 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Deleted volume successfully. Jul 10 06:53:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-87a8eeb9-4a5f-4004-a1bf-00aa3deaede9 tempest-VolumesTransfersV355Test-35737975 None] Lock "cinder-8774febe-ad7c-45f9-bfee-a4c05d79a18e-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:27 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=102,cinder:SELECT=78,cinder:INSERT=24,cinder:DELETE=6 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:53:27 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Flow 'volume_create_manager' (76a46a62-122e-4fa1-9307-3116912f1405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503e9095-7bd2-4a92-b555-becd7e2febe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503e9095-7bd2-4a92-b555-becd7e2febe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-165633482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd62513e-9d65-4811-bd49-f2cae5cc1cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d865a709b64a61807b678a3530a517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:28Z,use_quota=True,user_id='874590b9f21c4eb1b8bbdece7ea6412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d5dd59-3671-4d8d-9dfc-2d1aed5e084c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d5dd59-3671-4d8d-9dfc-2d1aed5e084c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab31515-a142-4dd7-a6c0-cbd0f1f0c587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:28 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:53:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab31515-a142-4dd7-a6c0-cbd0f1f0c587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bd62513e-9d65-4811-bd49-f2cae5cc1cda', 'volume_name': 'volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439cb535-be9c-4d30-8f11-aa4cf848a376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439cb535-be9c-4d30-8f11-aa4cf848a376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a832c849-285a-4b3a-8670-1ce79d3029f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Volume bd62513e-9d65-4811-bd49-f2cae5cc1cda: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 06:53:28 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Trying to clone bd62513e-9d65-4811-bd49-f2cae5cc1cda from image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:53:28 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:53:28 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Image download 20.69 MB at 20.69 MB/s Jul 10 06:53:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[969d22ec-656c-445a-9197-b7acc113994c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:29 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD Jul 10 06:53:29 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:29 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:29 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Temporary image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 is fetched for user 874590b9f21c4eb1b8bbdece7ea6412b. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:53:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[57caf564-0f87-47a1-be6d-7837e172aa5b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:30 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD Jul 10 06:53:30 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:30 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD" returned: 0 in 0.958s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-165633482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd62513e-9d65-4811-bd49-f2cae5cc1cda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d865a709b64a61807b678a3530a517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:28Z,use_quota=True,user_id='874590b9f21c4eb1b8bbdece7ea6412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Creating volume bd62513e-9d65-4811-bd49-f2cae5cc1cda {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:30 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:53:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:30 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda 1073741824 Jul 10 06:53:30 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:31 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda 1073741824" returned: 0 in 0.952s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:31 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda Jul 10 06:53:31 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:32 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda" returned: 0 in 0.749s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:32 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Attempting download of 3a4cb804-6b6d-41c8-ac4c-b431983d3649 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}])) to volume bd62513e-9d65-4811-bd49-f2cae5cc1cda. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:53:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f35503-3d83-4127-8230-6a0cfe123a08]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t6341w4m {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:32 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t6341w4m Jul 10 06:53:32 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:33 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t6341w4m" returned: 0 in 0.880s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t6341w4m {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:33 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t6341w4m Jul 10 06:53:33 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:34 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t6341w4m" returned: 1 in 0.795s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t6341w4m' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:53:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f889fc-c808-4f21-8141-065ce679ce10]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:34 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD Jul 10 06:53:34 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:35 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD" returned: 0 in 0.891s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:35 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] 3a4cb804-6b6d-41c8-ac4c-b431983d3649 was qcow2, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:53:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:35 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda Jul 10 06:53:35 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Flow 'volume_create_manager' (61fcbc47-5dec-4fed-a7cb-d82391940c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ecea1a-e775-4a86-876f-1e5ab3e755ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ecea1a-e775-4a86-876f-1e5ab3e755ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-936057297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865b0cfaab394058b640f69e1c14700d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:36Z,use_quota=True,user_id='30149161c661447eb84ea9ac8796247a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab3f605-a398-4b46-9a06-386575f0c257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab3f605-a398-4b46-9a06-386575f0c257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930df7f6-19f8-4c31-a8f8-038fd81fdb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930df7f6-19f8-4c31-a8f8-038fd81fdb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d', 'volume_name': 'volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f220776-ef6b-42c9-a49f-4f752f7a94f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f220776-ef6b-42c9-a49f-4f752f7a94f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61983e7d-096a-4145-9371-867d73d7fe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:36 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Volume bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d', 'volume_size': 1} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-936057297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865b0cfaab394058b640f69e1c14700d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:36Z,use_quota=True,user_id='30149161c661447eb84ea9ac8796247a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Creating volume bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:36 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:53:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:36 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d 1073741824 Jul 10 06:53:36 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:37 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d 1073741824" returned: 0 in 1.084s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:37 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d Jul 10 06:53:37 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:37 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda" returned: 0 in 2.542s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:37 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_wnkimjcsdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:53:37 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Converted 112.00 MB image at 44.04 MB/s Jul 10 06:53:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:37 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda 1G Jul 10 06:53:37 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:38 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d" returned: 0 in 0.857s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61983e7d-096a-4145-9371-867d73d7fe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55de1668-69f2-43ab-9984-246e30c6c795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:38 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Volume volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d (bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d): created successfully Jul 10 06:53:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55de1668-69f2-43ab-9984-246e30c6c795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Flow 'volume_create_manager' (61fcbc47-5dec-4fed-a7cb-d82391940c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-08851cdd-a677-4245-b9e9-7d3a888e98d6 tempest-VolumesTransfersV357Test-2030029284 None] Created volume successfully. Jul 10 06:53:38 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda 1G" returned: 0 in 0.762s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e79f3b-ca77-4ec7-95da-39577a895580]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:38 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda Jul 10 06:53:38 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:39 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda" returned: 0 in 0.961s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:39 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda Jul 10 06:53:39 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-51194683-d187-49cf-86d4-13ae08e1a260 tempest-VolumesTransfersV357Test-776889682 None] Transfer volume completed successfully. Jul 10 06:53:40 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda" returned: 1 in 0.884s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:53:40 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Downloaded image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}])) to volume bd62513e-9d65-4811-bd49-f2cae5cc1cda successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:53:40 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Temporary image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 for user 874590b9f21c4eb1b8bbdece7ea6412b is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:53:40 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Marking volume bd62513e-9d65-4811-bd49-f2cae5cc1cda as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:53:40 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Copying metadata from image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 to bd62513e-9d65-4811-bd49-f2cae5cc1cda. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:53:40 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Creating volume glance metadata for volume bd62513e-9d65-4811-bd49-f2cae5cc1cda backed by image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:53:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a832c849-285a-4b3a-8670-1ce79d3029f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c714e9-2eb2-4608-9cc5-19269dbcba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Volume volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda (bd62513e-9d65-4811-bd49-f2cae5cc1cda): created successfully Jul 10 06:53:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c714e9-2eb2-4608-9cc5-19269dbcba57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Flow 'volume_create_manager' (76a46a62-122e-4fa1-9307-3116912f1405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b9db9ac7-ea66-4b4f-bf03-5cf8cc5e2175 tempest-VolumesExtendTest-1026794088 None] Created volume successfully. Jul 10 06:53:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c0c8ca67-b98c-46c9-b8cd-9899874f9264 tempest-VolumesExtendTest-1026794088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c0c8ca67-b98c-46c9-b8cd-9899874f9264 tempest-VolumesExtendTest-1026794088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Acquiring lock "cinder-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[550f13d2-6240-41f8-8c07-5cf6590735d2]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c0c8ca67-b98c-46c9-b8cd-9899874f9264 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Lock "cinder-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Acquiring lock "cinder-quobyte-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Lock "cinder-quobyte-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03c8cd5-c6ff-415f-8ea7-b37e145ace53]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:41 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda Jul 10 06:53:41 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:41 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d Jul 10 06:53:41 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:42 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c0c8ca67-b98c-46c9-b8cd-9899874f9264 tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda" returned: 0 in 0.919s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c0c8ca67-b98c-46c9-b8cd-9899874f9264 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:42 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda Jul 10 06:53:42 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:42 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d" returned: 0 in 0.926s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:42 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d Jul 10 06:53:42 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:43 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c0c8ca67-b98c-46c9-b8cd-9899874f9264 tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda" returned: 1 in 0.863s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c0c8ca67-b98c-46c9-b8cd-9899874f9264 tempest-VolumesExtendTest-1026794088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c0c8ca67-b98c-46c9-b8cd-9899874f9264 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda 2G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:43 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d" returned: 0 in 0.771s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Lock "cinder-quobyte-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d" released by "delete_volume" :: held 1.759s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c0c8ca67-b98c-46c9-b8cd-9899874f9264 tempest-VolumesExtendTest-1026794088 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda 2G" returned: 0 in 0.107s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c0c8ca67-b98c-46c9-b8cd-9899874f9264 tempest-VolumesExtendTest-1026794088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.958s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Created reservations ['38c9ade3-76e9-4b1b-ba76-0d1570213a7e', '34696890-657c-40d6-95ba-6de148516094', 'ab9aceb2-70aa-491f-9d12-bae2062d1f74', '9fd1fdcc-cd85-4240-9806-cada31810696'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c0c8ca67-b98c-46c9-b8cd-9899874f9264 tempest-VolumesExtendTest-1026794088 None] Extend volume completed successfully. Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:43 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:53:43 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Flow 'volume_create_manager' (aa8ab290-f6fc-4928-adb6-f7185fb63094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023143ab-bd56-47ab-89c8-3e93552af9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023143ab-bd56-47ab-89c8-3e93552af9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1912967809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba981de-c800-4729-8bcd-088b8f86b912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f8224b381e4792a7509d1d3bff2e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:43Z,use_quota=True,user_id='a5d17eccb0434c80805e7321cadfed8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82c89cf-f8f9-45f3-ad70-f3d4d6928b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f82c89cf-f8f9-45f3-ad70-f3d4d6928b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac76d16-6794-4a81-b513-c795a372a47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Acquiring lock "cinder-bd62513e-9d65-4811-bd49-f2cae5cc1cda-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Lock "cinder-bd62513e-9d65-4811-bd49-f2cae5cc1cda-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Acquiring lock "cinder-quobyte-bd62513e-9d65-4811-bd49-f2cae5cc1cda" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Lock "cinder-quobyte-bd62513e-9d65-4811-bd49-f2cae5cc1cda" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb016bfc-f626-4d0c-b733-d2c211cc2bb8]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac76d16-6794-4a81-b513-c795a372a47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ba981de-c800-4729-8bcd-088b8f86b912', 'volume_name': 'volume-2ba981de-c800-4729-8bcd-088b8f86b912', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e360c35-6168-4c42-b192-21d3163aa3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e360c35-6168-4c42-b192-21d3163aa3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:43 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda Jul 10 06:53:43 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e78978-1c04-4dc4-8cf4-73bb6b846c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Volume 2ba981de-c800-4729-8bcd-088b8f86b912: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ba981de-c800-4729-8bcd-088b8f86b912', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 06:53:43 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Trying to clone 2ba981de-c800-4729-8bcd-088b8f86b912 from image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:44 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Flow 'volume_create_manager' (6d7d4e80-0869-4c83-a59b-849672701ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158b1447-e8b5-4b09-8b4f-ce5132ebc86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.059s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158b1447-e8b5-4b09-8b4f-ce5132ebc86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-224043282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4166ae6-c445-430d-9b19-639986704529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865b0cfaab394058b640f69e1c14700d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:44Z,use_quota=True,user_id='30149161c661447eb84ea9ac8796247a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09445409-affc-4aeb-80d1-ce7ad41b8949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09445409-affc-4aeb-80d1-ce7ad41b8949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13082747-8871-4cc3-bbb9-3eab7d3364c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13082747-8871-4cc3-bbb9-3eab7d3364c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4166ae6-c445-430d-9b19-639986704529', 'volume_name': 'volume-f4166ae6-c445-430d-9b19-639986704529', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00038654-733c-4beb-a8e7-593fb7bf7ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00038654-733c-4beb-a8e7-593fb7bf7ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16aadfa-2253-4c3b-a39d-6ad5003d18ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Volume f4166ae6-c445-430d-9b19-639986704529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4166ae6-c445-430d-9b19-639986704529', 'volume_size': 1} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-224043282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4166ae6-c445-430d-9b19-639986704529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865b0cfaab394058b640f69e1c14700d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:44Z,use_quota=True,user_id='30149161c661447eb84ea9ac8796247a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Creating volume f4166ae6-c445-430d-9b19-639986704529 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:44 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Deleted volume successfully. Jul 10 06:53:44 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529 1073741824 Jul 10 06:53:44 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:53:44 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Image download 20.69 MB at 20.69 MB/s Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d595ee61-b546-49c0-a738-bbed3964d4ec tempest-VolumesTransfersV357Test-2092958205 None] Lock "cinder-bbe44b26-6fa4-4de8-ae5c-ac9daa73da2d-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b88706d-9b7b-4b6c-b9f6-e2deacea9d79]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:44 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD Jul 10 06:53:44 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:44 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda" returned: 0 in 0.942s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:44 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda Jul 10 06:53:44 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:45 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529 1073741824" returned: 0 in 0.881s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:45 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:45 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Temporary image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 is fetched for user a5d17eccb0434c80805e7321cadfed8e. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:45 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529 Jul 10 06:53:45 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f160b9e-ae30-4103-8195-9cd376e964a6]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:45 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda" returned: 1 in 0.827s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:53:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:45 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD Jul 10 06:53:45 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:45 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda Jul 10 06:53:45 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:46 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529" returned: 0 in 0.704s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16aadfa-2253-4c3b-a39d-6ad5003d18ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4166ae6-c445-430d-9b19-639986704529', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121ddb3c-5167-430f-84ea-6a30e77ba475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Volume volume-f4166ae6-c445-430d-9b19-639986704529 (f4166ae6-c445-430d-9b19-639986704529): created successfully Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121ddb3c-5167-430f-84ea-6a30e77ba475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Flow 'volume_create_manager' (6d7d4e80-0869-4c83-a59b-849672701ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3424acd9-b787-4c2a-8bbd-dfcc6ad690cd tempest-VolumesTransfersV357Test-2030029284 None] Created volume successfully. Jul 10 06:53:46 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bd62513e-9d65-4811-bd49-f2cae5cc1cda" returned: 0 in 0.673s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:46 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Lock "cinder-quobyte-bd62513e-9d65-4811-bd49-f2cae5cc1cda" released by "delete_volume" :: held 2.513s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1912967809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba981de-c800-4729-8bcd-088b8f86b912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f8224b381e4792a7509d1d3bff2e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:43Z,use_quota=True,user_id='a5d17eccb0434c80805e7321cadfed8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Creating volume 2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:46 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:46 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 1073741824 Jul 10 06:53:46 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Created reservations ['ae2204ff-f915-4462-999f-72ee4e1017c1', 'd16a8a35-0a7d-4131-a903-7c04d0b8f1eb', '421785a6-c36b-4156-a3dd-6709412b6a62', '1efb1f5d-a26f-4149-b54c-1b2c783e902e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:46 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:53:46 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:47 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.736s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Deleted volume successfully. Jul 10 06:53:47 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 1073741824" returned: 0 in 0.885s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-728da784-0ca6-4048-ac7f-2573d6c473ae tempest-VolumesExtendTest-1026794088 None] Lock "cinder-bd62513e-9d65-4811-bd49-f2cae5cc1cda-delete_volume" released by "delete_volume" :: held 3.503s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:47 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 Jul 10 06:53:47 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Flow 'volume_create_manager' (a5cc49b4-c9ad-42d2-a84a-8241486efadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b1a14e-b3f2-4699-beb8-c784e661a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b1a14e-b3f2-4699-beb8-c784e661a660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1222904241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fd7907-eea4-4dbe-8a42-49fba931ce65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d865a709b64a61807b678a3530a517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:47Z,use_quota=True,user_id='874590b9f21c4eb1b8bbdece7ea6412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f21641-9ba5-40ad-ba36-ecd81bc48817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f21641-9ba5-40ad-ba36-ecd81bc48817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734c8f9b-bc32-4c3b-9e8c-7fc344bf18c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734c8f9b-bc32-4c3b-9e8c-7fc344bf18c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fd7907-eea4-4dbe-8a42-49fba931ce65', 'volume_name': 'volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188ba7c1-20eb-4f3c-bab7-12620db15112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (188ba7c1-20eb-4f3c-bab7-12620db15112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842660e1-fd9d-4570-8070-2e384b538d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Volume b9fd7907-eea4-4dbe-8a42-49fba931ce65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65', 'volume_size': 1} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Acquiring lock "cinder-f4166ae6-c445-430d-9b19-639986704529-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Lock "cinder-f4166ae6-c445-430d-9b19-639986704529-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Acquiring lock "cinder-quobyte-f4166ae6-c445-430d-9b19-639986704529" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Lock "cinder-quobyte-f4166ae6-c445-430d-9b19-639986704529" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f806e8f-4bbc-4936-bd09-b91e3f02e3f1]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:47 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912" returned: 0 in 0.807s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:47 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529 Jul 10 06:53:47 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1222904241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fd7907-eea4-4dbe-8a42-49fba931ce65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65d865a709b64a61807b678a3530a517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:47Z,use_quota=True,user_id='874590b9f21c4eb1b8bbdece7ea6412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Creating volume b9fd7907-eea4-4dbe-8a42-49fba931ce65 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:48 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:53:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:48 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 1073741824 Jul 10 06:53:48 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:48 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Attempting download of 3a4cb804-6b6d-41c8-ac4c-b431983d3649 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}])) to volume 2ba981de-c800-4729-8bcd-088b8f86b912. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:53:48 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d867d122-207f-4a08-a540-81f57632424d]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_dkkf_iog {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:48 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_dkkf_iog Jul 10 06:53:48 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:48 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529" returned: 0 in 0.968s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:48 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529 Jul 10 06:53:48 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:48 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_dkkf_iog" returned: 0 in 0.832s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_dkkf_iog {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:49 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 1073741824" returned: 0 in 1.016s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:49 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 Jul 10 06:53:49 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:49 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_dkkf_iog Jul 10 06:53:49 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:49 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4166ae6-c445-430d-9b19-639986704529" returned: 0 in 0.726s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Lock "cinder-quobyte-f4166ae6-c445-430d-9b19-639986704529" released by "delete_volume" :: held 1.742s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Created reservations ['2ed7abc7-194e-4401-b89a-fdb6ea0b0038', 'b5540b28-c5fa-4d51-ae09-54c2fa97f672', '1ca1506d-6fb9-4d83-b449-116d3db168e8', '2806dd84-7f9a-429e-8bd9-d94fad6fb14a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:49 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:53:49 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:49 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:49 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_dkkf_iog" returned: 1 in 0.796s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a4cb804-6b6d-41c8-ac4c-b431983d3649_dkkf_iog' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65" returned: 0 in 0.732s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c05383-bbef-4077-ace2-8119782738f1]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842660e1-fd9d-4570-8070-2e384b538d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4401ae56-d3a6-4636-a724-7d85715f26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:49 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Volume volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 (b9fd7907-eea4-4dbe-8a42-49fba931ce65): created successfully Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4401ae56-d3a6-4636-a724-7d85715f26d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Flow 'volume_create_manager' (a5cc49b4-c9ad-42d2-a84a-8241486efadf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4e7578e2-c5ef-48b6-beac-a2ffb3a1caaa tempest-VolumesExtendTest-1026794088 None] Created volume successfully. Jul 10 06:53:49 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD Jul 10 06:53:49 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:50 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.758s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:50 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Deleted volume successfully. Jul 10 06:53:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-57974c77-75fb-4d21-b0a5-dc657041ecaf tempest-VolumesTransfersV357Test-2092958205 None] Lock "cinder-f4166ae6-c445-430d-9b19-639986704529-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:50 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD" returned: 0 in 0.775s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:50 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] 3a4cb804-6b6d-41c8-ac4c-b431983d3649 was qcow2, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:53:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:50 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 Jul 10 06:53:50 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] Creating offline snapshot 6e070d54-54ba-4ab4-b69f-67859d612327 of volume b9fd7907-eea4-4dbe-8a42-49fba931ce65 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:53:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e1c3d9-3af0-4397-84b1-7a9fa03a6d28]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:51 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 Jul 10 06:53:51 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:52 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65" returned: 0 in 1.071s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:52 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 1G Jul 10 06:53:52 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:52 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912" returned: 0 in 2.344s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:52 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a4cb804-6b6d-41c8-ac4c-b431983d3649_t1wsmqzcdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:53:52 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Converted 112.00 MB image at 47.75 MB/s Jul 10 06:53:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:52 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 1G Jul 10 06:53:52 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:53 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 1G" returned: 0 in 1.022s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:53 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 Jul 10 06:53:53 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:53 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 1G" returned: 0 in 0.867s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f4d865-d9e5-4e4b-b63d-62e4b0428d44]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:53 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:53 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 is being set with open permissions: ugo+rw Jul 10 06:53:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:53 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 Jul 10 06:53:53 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:53 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 Jul 10 06:53:53 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:54 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327" returned: 0 in 0.734s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:54 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.info Jul 10 06:53:54 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:54 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912" returned: 0 in 0.848s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:54 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 Jul 10 06:53:54 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:55 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.info" returned: 0 in 0.714s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:55 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.info is being set with open permissions: ugo+rw Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:55 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.info Jul 10 06:53:55 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:55 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912" returned: 1 in 0.824s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Downloaded image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 ((None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}])) to volume 2ba981de-c800-4729-8bcd-088b8f86b912 successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Temporary image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 for user a5d17eccb0434c80805e7321cadfed8e is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Marking volume 2ba981de-c800-4729-8bcd-088b8f86b912 as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Copying metadata from image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 to 2ba981de-c800-4729-8bcd-088b8f86b912. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Creating volume glance metadata for volume 2ba981de-c800-4729-8bcd-088b8f86b912 backed by image 3a4cb804-6b6d-41c8-ac4c-b431983d3649 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2e78978-1c04-4dc4-8cf4-73bb6b846c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba981de-c800-4729-8bcd-088b8f86b912', 'volume_size': 1, 'image_id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9004ba9d44aa4a698d99edda638c4b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3a4cb804-6b6d-41c8-ac4c-b431983d3649', 'created_at': datetime.datetime(2026, 7, 10, 4, 31, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 31, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a4cb804-6b6d-41c8-ac4c-b431983d3649/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7df2b2-5b5a-4400-bd78-ea58fd909c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:55 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Volume volume-2ba981de-c800-4729-8bcd-088b8f86b912 (2ba981de-c800-4729-8bcd-088b8f86b912): created successfully Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7df2b2-5b5a-4400-bd78-ea58fd909c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Flow 'volume_create_manager' (aa8ab290-f6fc-4928-adb6-f7185fb63094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-43c49a09-3dff-487f-91c5-4e29fe90b79c tempest-TestShelveInstance-1851196865 None] Created volume successfully. Jul 10 06:53:56 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.info" returned: 0 in 0.702s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.121s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Flow 'volume_create_manager' (70b31d88-a968-470c-b92c-b97f4d1802e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dabaa6e-5981-4198-a0a1-3533ac610a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dabaa6e-5981-4198-a0a1-3533ac610a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1324357344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3975f4-5b4b-436c-a65f-e29153becb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ec57d2e3064f0a893d8cd0f85a22cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:56Z,use_quota=True,user_id='59068f5146d9424ba6ccb7c019ee9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c09de5-7d8c-49a3-aebd-17f0e7c87536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c09de5-7d8c-49a3-aebd-17f0e7c87536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae073d40-dcf8-4a5c-8a98-3b2b04dbb03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae073d40-dcf8-4a5c-8a98-3b2b04dbb03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3975f4-5b4b-436c-a65f-e29153becb13', 'volume_name': 'volume-8e3975f4-5b4b-436c-a65f-e29153becb13', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5783c9b5-1803-4b48-b9ef-24016128fec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5783c9b5-1803-4b48-b9ef-24016128fec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84679d7d-e324-4b8a-8e47-7dd7ae519774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:56 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Volume 8e3975f4-5b4b-436c-a65f-e29153becb13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3975f4-5b4b-436c-a65f-e29153becb13', 'volume_size': 1} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1324357344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3975f4-5b4b-436c-a65f-e29153becb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75ec57d2e3064f0a893d8cd0f85a22cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:56Z,use_quota=True,user_id='59068f5146d9424ba6ccb7c019ee9320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Creating volume 8e3975f4-5b4b-436c-a65f-e29153becb13 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:56 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:53:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-eead0e06-4401-46ae-ac79-be9e00ae523d tempest-VolumesExtendTest-1026794088 None] Create snapshot completed successfully Jul 10 06:53:56 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13 1073741824 Jul 10 06:53:56 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:57 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13 1073741824" returned: 0 in 0.852s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:57 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13 Jul 10 06:53:57 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50960e95-c830-4851-9aaa-7786e1ba1a09 tempest-VolumesExtendTest-1026794088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:57 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13" returned: 0 in 0.721s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50960e95-c830-4851-9aaa-7786e1ba1a09 tempest-VolumesExtendTest-1026794088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.333s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[74237770-7e15-4651-a3bf-2b733d1f5803]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50960e95-c830-4851-9aaa-7786e1ba1a09 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84679d7d-e324-4b8a-8e47-7dd7ae519774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3975f4-5b4b-436c-a65f-e29153becb13', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb10295-4a61-48d6-88b7-c68a618cb4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Volume volume-8e3975f4-5b4b-436c-a65f-e29153becb13 (8e3975f4-5b4b-436c-a65f-e29153becb13): created successfully Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb10295-4a61-48d6-88b7-c68a618cb4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Flow 'volume_create_manager' (70b31d88-a968-470c-b92c-b97f4d1802e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-563d9560-95af-4df9-9037-248d983b8f17 tempest-VolumesNegativeTest-573040408 None] Created volume successfully. Jul 10 06:53:57 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 Jul 10 06:53:57 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:58 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50960e95-c830-4851-9aaa-7786e1ba1a09 tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65" returned: 0 in 0.913s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50960e95-c830-4851-9aaa-7786e1ba1a09 tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 2G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-50960e95-c830-4851-9aaa-7786e1ba1a09 tempest-VolumesExtendTest-1026794088 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 2G" returned: 0 in 0.162s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-50960e95-c830-4851-9aaa-7786e1ba1a09 tempest-VolumesExtendTest-1026794088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.117s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-50960e95-c830-4851-9aaa-7786e1ba1a09 tempest-VolumesExtendTest-1026794088 None] Extend volume completed successfully. Jul 10 06:53:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Acquiring lock "cinder-6e070d54-54ba-4ab4-b69f-67859d612327-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Lock "cinder-6e070d54-54ba-4ab4-b69f-67859d612327-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Acquiring lock "cinder-quobyte-b9fd7907-eea4-4dbe-8a42-49fba931ce65" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Lock "cinder-quobyte-b9fd7907-eea4-4dbe-8a42-49fba931ce65" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Acquiring lock "cinder-quobyte-6e070d54-54ba-4ab4-b69f-67859d612327" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Lock "cinder-quobyte-6e070d54-54ba-4ab4-b69f-67859d612327" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Deleting offline snapshot 6e070d54-54ba-4ab4-b69f-67859d612327 of volume b9fd7907-eea4-4dbe-8a42-49fba931ce65 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:53:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] snapshot_file for this snap is: volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:53:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea65f419-c73c-4b04-817f-3015cdc7651f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:59 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 Jul 10 06:53:59 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:00 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327" returned: 0 in 0.799s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:54:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5b87fe-4ca4-434d-a6e1-20ce367cd44f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:00 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 Jul 10 06:54:00 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:01 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65" returned: 0 in 0.775s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:01 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 Jul 10 06:54:01 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:02 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327" returned: 0 in 0.873s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:02 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327 Jul 10 06:54:02 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:03 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65.6e070d54-54ba-4ab4-b69f-67859d612327" returned: 0 in 0.710s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Lock "cinder-quobyte-6e070d54-54ba-4ab4-b69f-67859d612327" released by "_delete_snapshot" :: held 3.261s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Lock "cinder-quobyte-b9fd7907-eea4-4dbe-8a42-49fba931ce65" released by "delete_snapshot" :: held 3.285s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:03 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Created reservations ['d1f9f242-e078-46c0-bbb1-e646351d380a', '4b3aaccb-adf8-427f-abca-60b931a178a8', '71eb6afd-ef06-43db-a1e2-e879f56d2531', '74b8f710-f19e-42c8-9ab5-a6c92bcc88f8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:54:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Delete snapshot completed successfully. Jul 10 06:54:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-10d1384c-bba5-4dbc-9dec-03b53cba1adb tempest-VolumesExtendTest-1026794088 None] Lock "cinder-6e070d54-54ba-4ab4-b69f-67859d612327-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4ba5650e-ea57-46c6-bb07-77b612edb205 req-788d32d4-90fd-4609-82c6-26cd4abde6ee tempest-TestShelveInstance-1851196865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4ba5650e-ea57-46c6-bb07-77b612edb205 req-788d32d4-90fd-4609-82c6-26cd4abde6ee tempest-TestShelveInstance-1851196865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b36a48-8e80-467e-b014-978047fcf0d7]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4ba5650e-ea57-46c6-bb07-77b612edb205 req-788d32d4-90fd-4609-82c6-26cd4abde6ee tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:03 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 Jul 10 06:54:03 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Acquiring lock "cinder-b9fd7907-eea4-4dbe-8a42-49fba931ce65-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Lock "cinder-b9fd7907-eea4-4dbe-8a42-49fba931ce65-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Acquiring lock "cinder-quobyte-b9fd7907-eea4-4dbe-8a42-49fba931ce65" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Lock "cinder-quobyte-b9fd7907-eea4-4dbe-8a42-49fba931ce65" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab37d6a-9d9c-4eee-a1ea-c3450b69fdc8]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:04 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 Jul 10 06:54:04 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:04 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4ba5650e-ea57-46c6-bb07-77b612edb205 req-788d32d4-90fd-4609-82c6-26cd4abde6ee tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912" returned: 0 in 1.053s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4ba5650e-ea57-46c6-bb07-77b612edb205 req-788d32d4-90fd-4609-82c6-26cd4abde6ee tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:04 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 Jul 10 06:54:04 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:05 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65" returned: 0 in 1.163s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:05 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65 Jul 10 06:54:05 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:05 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4ba5650e-ea57-46c6-bb07-77b612edb205 req-788d32d4-90fd-4609-82c6-26cd4abde6ee tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912" returned: 1 in 0.968s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4ba5650e-ea57-46c6-bb07-77b612edb205 req-788d32d4-90fd-4609-82c6-26cd4abde6ee tempest-TestShelveInstance-1851196865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:54:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4ba5650e-ea57-46c6-bb07-77b612edb205 req-788d32d4-90fd-4609-82c6-26cd4abde6ee tempest-TestShelveInstance-1851196865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.063s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4ba5650e-ea57-46c6-bb07-77b612edb205 req-788d32d4-90fd-4609-82c6-26cd4abde6ee tempest-TestShelveInstance-1851196865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-2ba981de-c800-4729-8bcd-088b8f86b912', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98fe1704-38a6-4ada-a4c3-5cdfa86caf28', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:54:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-4ba5650e-ea57-46c6-bb07-77b612edb205 req-788d32d4-90fd-4609-82c6-26cd4abde6ee tempest-TestShelveInstance-1851196865 None] attachment_update completed successfully. Jul 10 06:54:06 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b9fd7907-eea4-4dbe-8a42-49fba931ce65" returned: 0 in 0.898s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Lock "cinder-quobyte-b9fd7907-eea4-4dbe-8a42-49fba931ce65" released by "delete_volume" :: held 2.148s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:06 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Created reservations ['c8b4ef38-2dff-45e5-abde-129002abae25', '5e8273f3-b1d1-4362-bb43-16cd4d54fae0', 'caedd3b5-4f79-41e4-a698-4cc2d7e72b52', 'd83ecb22-0496-4b0e-a576-7aa0677fe3a1'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:54:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:06 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:54:06 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:07 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.767s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:07 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:54:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Deleted volume successfully. Jul 10 06:54:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fe035a58-b39e-4ad4-b666-064c27f036cc tempest-VolumesExtendTest-1026794088 None] Lock "cinder-b9fd7907-eea4-4dbe-8a42-49fba931ce65-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Flow 'volume_create_manager' (fb0bf491-911f-43be-b306-a1e05fbe4469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e109920-b598-40e7-871b-c42344c93de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e109920-b598-40e7-871b-c42344c93de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1112078971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48eb817-9913-4225-9e16-c419d065d49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c19470deb724413abefaa94dc867303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:54:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:54:11Z,use_quota=True,user_id='ebd54e308a744fc3819e52bd76a95a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f188577f-8f9a-4fc4-9dd5-0b9d7f4be5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f188577f-8f9a-4fc4-9dd5-0b9d7f4be5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a72a33-757b-431f-9595-ff11eb83e5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a72a33-757b-431f-9595-ff11eb83e5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48eb817-9913-4225-9e16-c419d065d49f', 'volume_name': 'volume-d48eb817-9913-4225-9e16-c419d065d49f', 'volume_size': 2}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb445119-a930-42fb-9ef3-bf05269b44a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb445119-a930-42fb-9ef3-bf05269b44a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79cbe1d-4527-4a24-aefc-e398facd2808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Volume d48eb817-9913-4225-9e16-c419d065d49f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48eb817-9913-4225-9e16-c419d065d49f', 'volume_size': 2} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1112078971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48eb817-9913-4225-9e16-c419d065d49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c19470deb724413abefaa94dc867303',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:54:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:54:11Z,use_quota=True,user_id='ebd54e308a744fc3819e52bd76a95a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Creating volume d48eb817-9913-4225-9e16-c419d065d49f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:54:11 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f 2147483648 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:11 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f 2147483648 Jul 10 06:54:11 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:11 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:54:11 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:12 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.940s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:54:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:54:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:54:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:54:12 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f 2147483648" returned: 0 in 1.334s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:12 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f Jul 10 06:54:12 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:13 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f" returned: 0 in 0.914s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:54:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f79cbe1d-4527-4a24-aefc-e398facd2808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48eb817-9913-4225-9e16-c419d065d49f', 'volume_size': 2}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a559047d-f3c5-48a5-b46c-641462200b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Volume volume-d48eb817-9913-4225-9e16-c419d065d49f (d48eb817-9913-4225-9e16-c419d065d49f): created successfully Jul 10 06:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a559047d-f3c5-48a5-b46c-641462200b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Flow 'volume_create_manager' (fb0bf491-911f-43be-b306-a1e05fbe4469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:54:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a7244d07-947f-420f-8daf-09cb544a1dd8 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Created volume successfully. Jul 10 06:54:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Creating offline snapshot 2c53ac2d-27b4-40e8-895b-3baee34fa739 of volume d48eb817-9913-4225-9e16-c419d065d49f {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:54:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[230a89ad-571c-4e89-8311-44b63fef1998]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:15 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f Jul 10 06:54:15 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:16 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f" returned: 0 in 1.210s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 2G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:16 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 2G Jul 10 06:54:16 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:17 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 2G" returned: 0 in 1.465s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48eb817-9913-4225-9e16-c419d065d49f -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:17 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48eb817-9913-4225-9e16-c419d065d49f -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 Jul 10 06:54:17 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:18 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d48eb817-9913-4225-9e16-c419d065d49f -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739" returned: 0 in 1.105s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:18 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 is being set with open permissions: ugo+rw Jul 10 06:54:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:18 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 Jul 10 06:54:18 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:19 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739" returned: 0 in 0.860s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:19 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=110,cinder:SELECT=86,cinder:INSERT=37,cinder:DELETE=5 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:54:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:19 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.info Jul 10 06:54:19 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:20 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.info" returned: 0 in 0.876s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:20 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.info is being set with open permissions: ugo+rw Jul 10 06:54:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:20 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.info Jul 10 06:54:20 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:21 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.info" returned: 0 in 0.705s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.388s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ee7ddb2c-6754-4bc9-a6c9-22f0d4ba252d tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Create snapshot completed successfully Jul 10 06:54:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Acquiring lock "cinder-2c53ac2d-27b4-40e8-895b-3baee34fa739-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "cinder-2c53ac2d-27b4-40e8-895b-3baee34fa739-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Acquiring lock "cinder-quobyte-d48eb817-9913-4225-9e16-c419d065d49f" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "cinder-quobyte-d48eb817-9913-4225-9e16-c419d065d49f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Acquiring lock "cinder-quobyte-2c53ac2d-27b4-40e8-895b-3baee34fa739" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "cinder-quobyte-2c53ac2d-27b4-40e8-895b-3baee34fa739" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Deleting offline snapshot 2c53ac2d-27b4-40e8-895b-3baee34fa739 of volume d48eb817-9913-4225-9e16-c419d065d49f {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:54:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] snapshot_file for this snap is: volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:54:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d579ff16-b9e4-44ec-804f-dd06e10f0c58]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:22 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 Jul 10 06:54:22 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:23 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739" returned: 0 in 0.804s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d48eb817-9913-4225-9e16-c419d065d49f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:54:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad97c8c-dbf7-4b37-bc61-a4660992297a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:23 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f Jul 10 06:54:23 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:24 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f" returned: 0 in 0.891s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:24 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 Jul 10 06:54:24 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:25 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739" returned: 0 in 0.914s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:25 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739 Jul 10 06:54:25 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:26 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f.2c53ac2d-27b4-40e8-895b-3baee34fa739" returned: 0 in 0.788s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "cinder-quobyte-2c53ac2d-27b4-40e8-895b-3baee34fa739" released by "_delete_snapshot" :: held 3.536s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "cinder-quobyte-d48eb817-9913-4225-9e16-c419d065d49f" released by "delete_snapshot" :: held 3.566s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:26 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Created reservations ['2b1d4c38-83aa-4d4f-bbac-28a1271ac6cd', 'a6ea8f3a-055f-4306-8a52-22da53412516', 'b5326a64-ab48-4017-809c-254ace07a9cb', 'af403fb1-1108-4377-be76-f633f602d8d9'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:54:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Delete snapshot completed successfully. Jul 10 06:54:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-14bf6ebb-d6b1-4260-be69-b28524d3dba3 tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "cinder-2c53ac2d-27b4-40e8-895b-3baee34fa739-delete_snapshot" released by "delete_snapshot" :: held 3.743s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Acquiring lock "cinder-d48eb817-9913-4225-9e16-c419d065d49f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "cinder-d48eb817-9913-4225-9e16-c419d065d49f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Acquiring lock "cinder-quobyte-d48eb817-9913-4225-9e16-c419d065d49f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "cinder-quobyte-d48eb817-9913-4225-9e16-c419d065d49f" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[38320709-1dad-4bd1-9907-e20b9c54d250]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:27 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f Jul 10 06:54:27 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:27 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f" returned: 0 in 0.843s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:27 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f Jul 10 06:54:27 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:28 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d48eb817-9913-4225-9e16-c419d065d49f" returned: 0 in 0.777s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "cinder-quobyte-d48eb817-9913-4225-9e16-c419d065d49f" released by "delete_volume" :: held 1.713s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:28 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=77,cinder:UPDATE=73,cinder:INSERT=26,cinder:DELETE=10 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:54:28 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Created reservations ['60cc3530-8105-47dc-95c0-41649984209e', 'b9b65464-e26f-473a-b0de-67192f76228b', '60768dd9-29e1-4d3d-9d1c-1722a98bb0ec', 'ce8ce4bc-27c2-4fb8-9a2b-1ccecc133c97'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:54:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:28 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:54:28 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:29 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.834s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:29 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:54:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Deleted volume successfully. Jul 10 06:54:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fbbad250-f994-4479-8f8f-f8570d402f2e tempest-VolumesSnapshotNegativeTestJSON-1239419485 None] Lock "cinder-d48eb817-9913-4225-9e16-c419d065d49f-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Acquiring lock "cinder-8e3975f4-5b4b-436c-a65f-e29153becb13-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Lock "cinder-8e3975f4-5b4b-436c-a65f-e29153becb13-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Acquiring lock "cinder-quobyte-8e3975f4-5b4b-436c-a65f-e29153becb13" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Lock "cinder-quobyte-8e3975f4-5b4b-436c-a65f-e29153becb13" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4882f853-ec5f-48f0-a11a-1ead0896f75c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:31 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13 Jul 10 06:54:31 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:32 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13" returned: 0 in 0.797s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:32 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13 Jul 10 06:54:32 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:32 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8e3975f4-5b4b-436c-a65f-e29153becb13" returned: 0 in 0.723s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Lock "cinder-quobyte-8e3975f4-5b4b-436c-a65f-e29153becb13" released by "delete_volume" :: held 1.570s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Created reservations ['6b6cd6a0-40cd-4ba7-a195-d9660136c428', 'bf311f6a-0bbb-4397-9c24-0e2b4c7dc00f', '21770833-ff9b-4f91-ac57-7011afef0dfd', '94c47a9e-5e6f-4378-a481-cb65acb27a8a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:54:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:32 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:54:32 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:33 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.800s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:33 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:54:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Deleted volume successfully. Jul 10 06:54:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cfed8428-54ba-4d74-bbaf-bb4c0b5c8634 tempest-VolumesNegativeTest-573040408 None] Lock "cinder-8e3975f4-5b4b-436c-a65f-e29153becb13-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:42 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=12 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:54:43 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=24,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Flow 'volume_create_manager' (fe97a552-8fec-41f0-b13b-3decb40780b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2700b95c-3d4e-4543-bcd1-3fe2be851c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2700b95c-3d4e-4543-bcd1-3fe2be851c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1446432174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f080d3-d6f7-420d-a191-92a498ff67fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681f5f8660cf421b9e4a563e5b2470e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:54:48Z,use_quota=True,user_id='ff10ad50513447cc9a3c5ff0fb510825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a61dbeb-a84d-4db4-82f4-973146d0e82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a61dbeb-a84d-4db4-82f4-973146d0e82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ecd0b4-625e-44bd-aee8-b4a3c5d72c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ecd0b4-625e-44bd-aee8-b4a3c5d72c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f080d3-d6f7-420d-a191-92a498ff67fe', 'volume_name': 'volume-c3f080d3-d6f7-420d-a191-92a498ff67fe', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f682ca-27b5-4388-9812-46c417478864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f682ca-27b5-4388-9812-46c417478864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b08c38a-384a-47f0-bc6e-ec37b5dec0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Volume c3f080d3-d6f7-420d-a191-92a498ff67fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f080d3-d6f7-420d-a191-92a498ff67fe', 'volume_size': 1} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1446432174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f080d3-d6f7-420d-a191-92a498ff67fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681f5f8660cf421b9e4a563e5b2470e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:54:48Z,use_quota=True,user_id='ff10ad50513447cc9a3c5ff0fb510825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:54:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Creating volume c3f080d3-d6f7-420d-a191-92a498ff67fe {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:54:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:54:48 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:54:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:48 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe 1073741824 Jul 10 06:54:48 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:49 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe 1073741824" returned: 0 in 1.226s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:49 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe Jul 10 06:54:49 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:49 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe" returned: 0 in 0.715s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:54:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b08c38a-384a-47f0-bc6e-ec37b5dec0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f080d3-d6f7-420d-a191-92a498ff67fe', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df494706-f11c-4325-bbef-bedab8a0ee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:50 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Volume volume-c3f080d3-d6f7-420d-a191-92a498ff67fe (c3f080d3-d6f7-420d-a191-92a498ff67fe): created successfully Jul 10 06:54:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df494706-f11c-4325-bbef-bedab8a0ee6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Flow 'volume_create_manager' (fe97a552-8fec-41f0-b13b-3decb40780b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:54:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-636efbb7-0d19-4d7c-97ea-939f4104aab0 tempest-VolumesSnapshotTestJSON-645064773 None] Created volume successfully. Jul 10 06:54:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-bbe7e6de-41ed-4811-95ed-077aa9904e63 req-56822a9b-302f-442f-a939-8127bbf49673 tempest-TestShelveInstance-1851196865 None] Terminate volume connection completed successfully. Jul 10 06:54:50 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-bbe7e6de-41ed-4811-95ed-077aa9904e63 req-56822a9b-302f-442f-a939-8127bbf49673 tempest-TestShelveInstance-1851196865 None] Deleting attachment 98fe1704-38a6-4ada-a4c3-5cdfa86caf28. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:54:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] Creating offline snapshot 67ad4d5e-e970-4e17-ac6d-f8617695d2fc of volume c3f080d3-d6f7-420d-a191-92a498ff67fe {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:54:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f8a5d3-ab00-4427-9d75-51fbb4111c19]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:51 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe Jul 10 06:54:51 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:52 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe" returned: 0 in 0.845s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:52 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc 1G Jul 10 06:54:52 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:53 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc 1G" returned: 0 in 1.085s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f080d3-d6f7-420d-a191-92a498ff67fe -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:53 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f080d3-d6f7-420d-a191-92a498ff67fe -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc Jul 10 06:54:53 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:54 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f080d3-d6f7-420d-a191-92a498ff67fe -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc" returned: 0 in 1.198s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:54 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc is being set with open permissions: ugo+rw Jul 10 06:54:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:54 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc Jul 10 06:54:54 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:55 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc" returned: 0 in 0.820s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:55 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.info Jul 10 06:54:55 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:56 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.info" returned: 0 in 0.786s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:56 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.info is being set with open permissions: ugo+rw Jul 10 06:54:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:56 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.info Jul 10 06:54:56 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:56 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.info" returned: 0 in 0.740s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.570s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5e45ceed-95d3-4832-8e90-6c4a209dffb9 tempest-VolumesSnapshotTestJSON-645064773 None] Create snapshot completed successfully Jul 10 06:54:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5af29fd0-dabf-401a-b6af-996681ef160b req-f766cefa-54e6-4e9a-8885-6048ea98bca8 tempest-TestShelveInstance-1851196865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5af29fd0-dabf-401a-b6af-996681ef160b req-f766cefa-54e6-4e9a-8885-6048ea98bca8 tempest-TestShelveInstance-1851196865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d70ec6-1be7-47d2-828a-0cd131d02555]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-5af29fd0-dabf-401a-b6af-996681ef160b req-f766cefa-54e6-4e9a-8885-6048ea98bca8 tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:57 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 Jul 10 06:54:57 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-67ad4d5e-e970-4e17-ac6d-f8617695d2fc-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-67ad4d5e-e970-4e17-ac6d-f8617695d2fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-c3f080d3-d6f7-420d-a191-92a498ff67fe" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-c3f080d3-d6f7-420d-a191-92a498ff67fe" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-67ad4d5e-e970-4e17-ac6d-f8617695d2fc" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-67ad4d5e-e970-4e17-ac6d-f8617695d2fc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Deleting offline snapshot 67ad4d5e-e970-4e17-ac6d-f8617695d2fc of volume c3f080d3-d6f7-420d-a191-92a498ff67fe {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:54:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] snapshot_file for this snap is: volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:54:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d566b95-1a44-4156-ba03-c64af485d1dd]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:58 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc Jul 10 06:54:58 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:58 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-5af29fd0-dabf-401a-b6af-996681ef160b req-f766cefa-54e6-4e9a-8885-6048ea98bca8 tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912" returned: 0 in 0.992s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-5af29fd0-dabf-401a-b6af-996681ef160b req-f766cefa-54e6-4e9a-8885-6048ea98bca8 tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:58 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 Jul 10 06:54:58 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:59 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc" returned: 0 in 1.053s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3f080d3-d6f7-420d-a191-92a498ff67fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:54:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[555ba171-956d-4e9f-a227-af36702fc1b9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:59 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe Jul 10 06:54:59 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:59 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-5af29fd0-dabf-401a-b6af-996681ef160b req-f766cefa-54e6-4e9a-8885-6048ea98bca8 tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912" returned: 1 in 1.016s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-5af29fd0-dabf-401a-b6af-996681ef160b req-f766cefa-54e6-4e9a-8885-6048ea98bca8 tempest-TestShelveInstance-1851196865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:54:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-5af29fd0-dabf-401a-b6af-996681ef160b req-f766cefa-54e6-4e9a-8885-6048ea98bca8 tempest-TestShelveInstance-1851196865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.062s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-5af29fd0-dabf-401a-b6af-996681ef160b req-f766cefa-54e6-4e9a-8885-6048ea98bca8 tempest-TestShelveInstance-1851196865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-2ba981de-c800-4729-8bcd-088b8f86b912', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31f58db1-78b8-4588-ae0a-a1ff37ee9e7c', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:54:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-5af29fd0-dabf-401a-b6af-996681ef160b req-f766cefa-54e6-4e9a-8885-6048ea98bca8 tempest-TestShelveInstance-1851196865 None] attachment_update completed successfully. Jul 10 06:55:00 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe" returned: 0 in 0.859s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:00 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc Jul 10 06:55:00 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:00 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc" returned: 0 in 0.795s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:00 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc Jul 10 06:55:00 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:01 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe.67ad4d5e-e970-4e17-ac6d-f8617695d2fc" returned: 0 in 0.726s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-67ad4d5e-e970-4e17-ac6d-f8617695d2fc" released by "_delete_snapshot" :: held 3.583s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-c3f080d3-d6f7-420d-a191-92a498ff67fe" released by "delete_snapshot" :: held 3.606s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:01 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Created reservations ['38546df7-2c5b-487b-8ed7-9cc4a811087b', '86bc2fea-2b09-4d64-8983-b5d0685e9b6e', 'cab8fa93-193f-408d-a5df-32c878b0ff28', 'd39170e7-9350-47ef-b5b4-ba869c563a57'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:55:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Delete snapshot completed successfully. Jul 10 06:55:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165b693e-47e9-4a2c-9aad-82dd3a12cac1 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-67ad4d5e-e970-4e17-ac6d-f8617695d2fc-delete_snapshot" released by "delete_snapshot" :: held 3.814s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Flow 'volume_create_manager' (30dbaba1-c604-40be-b689-9f3a48dde05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11b4392-a254-414f-b3d6-4045583b6e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e11b4392-a254-414f-b3d6-4045583b6e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1471133420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9702742f-c307-48ed-9669-180402d7fba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681f5f8660cf421b9e4a563e5b2470e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:55:03Z,use_quota=True,user_id='ff10ad50513447cc9a3c5ff0fb510825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f8ce83-b988-4868-a5f7-687df5d38eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f8ce83-b988-4868-a5f7-687df5d38eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500c1eee-1056-413c-9209-e64b2217677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500c1eee-1056-413c-9209-e64b2217677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9702742f-c307-48ed-9669-180402d7fba0', 'volume_name': 'volume-9702742f-c307-48ed-9669-180402d7fba0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4fa33d-d4df-4509-b31e-17e359d0a048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4fa33d-d4df-4509-b31e-17e359d0a048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d847d2-ca06-4c45-8da5-4110ae26a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Volume 9702742f-c307-48ed-9669-180402d7fba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9702742f-c307-48ed-9669-180402d7fba0', 'volume_size': 1} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1471133420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9702742f-c307-48ed-9669-180402d7fba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681f5f8660cf421b9e4a563e5b2470e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:55:03Z,use_quota=True,user_id='ff10ad50513447cc9a3c5ff0fb510825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Creating volume 9702742f-c307-48ed-9669-180402d7fba0 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:55:02 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:55:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:02 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 1073741824 Jul 10 06:55:02 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:03 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 1073741824" returned: 0 in 1.045s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:03 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 Jul 10 06:55:03 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:04 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0" returned: 0 in 0.655s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:55:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d847d2-ca06-4c45-8da5-4110ae26a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9702742f-c307-48ed-9669-180402d7fba0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e080fb-4e6c-4204-90e2-05def53eb6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Volume volume-9702742f-c307-48ed-9669-180402d7fba0 (9702742f-c307-48ed-9669-180402d7fba0): created successfully Jul 10 06:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e080fb-4e6c-4204-90e2-05def53eb6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Flow 'volume_create_manager' (30dbaba1-c604-40be-b689-9f3a48dde05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:55:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1cdbdfcf-0770-4210-a4ce-5be3bce52a43 tempest-VolumesSnapshotTestJSON-645064773 None] Created volume successfully. Jul 10 06:55:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] Creating offline snapshot f99ad836-d6f7-4896-b451-61ffb51d04d4 of volume 9702742f-c307-48ed-9669-180402d7fba0 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:55:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[89352b00-1e98-41f0-b89b-d6910db0576f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:05 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 Jul 10 06:55:05 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:05 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0" returned: 0 in 0.786s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:05 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 1G Jul 10 06:55:05 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:06 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 1G" returned: 0 in 0.836s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9702742f-c307-48ed-9669-180402d7fba0 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:06 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9702742f-c307-48ed-9669-180402d7fba0 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 Jul 10 06:55:06 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:07 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9702742f-c307-48ed-9669-180402d7fba0 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4" returned: 0 in 0.684s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:07 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 is being set with open permissions: ugo+rw Jul 10 06:55:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:07 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 Jul 10 06:55:07 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:08 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4" returned: 0 in 0.645s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:08 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.info Jul 10 06:55:08 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:08 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.info" returned: 0 in 0.682s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:08 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.info is being set with open permissions: ugo+rw Jul 10 06:55:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:08 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.info Jul 10 06:55:08 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:09 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.info" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.654s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8654e838-915d-488e-a786-0c1ed453e633 tempest-VolumesSnapshotTestJSON-645064773 None] Create snapshot completed successfully Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Flow 'volume_create_manager' (b59cd00e-4aa4-48dc-bd40-ab5e2de135db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5731828-5eee-44a8-a15e-2aaa5ce4a47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5731828-5eee-44a8-a15e-2aaa5ce4a47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1690605209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c38b5d8-fe65-47c9-a0cc-75406a517226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681f5f8660cf421b9e4a563e5b2470e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:55:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f99ad836-d6f7-4896-b451-61ffb51d04d4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:55:11Z,use_quota=True,user_id='ff10ad50513447cc9a3c5ff0fb510825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82235de3-a11a-4338-a82f-337ed3ddc198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82235de3-a11a-4338-a82f-337ed3ddc198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e998aaa-219e-4187-acef-2aab5fac8d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e998aaa-219e-4187-acef-2aab5fac8d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c38b5d8-fe65-47c9-a0cc-75406a517226', 'volume_name': 'volume-3c38b5d8-fe65-47c9-a0cc-75406a517226', 'volume_size': 2, 'snapshot_id': 'f99ad836-d6f7-4896-b451-61ffb51d04d4'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30af4e8-d125-4ec8-8a8d-2363b6b763fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30af4e8-d125-4ec8-8a8d-2363b6b763fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e223d784-44dd-4fd5-a510-40c81d9ea212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Volume 3c38b5d8-fe65-47c9-a0cc-75406a517226: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c38b5d8-fe65-47c9-a0cc-75406a517226', 'volume_size': 2, 'snapshot_id': 'f99ad836-d6f7-4896-b451-61ffb51d04d4'} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-f99ad836-d6f7-4896-b451-61ffb51d04d4-3c38b5d8-fe65-47c9-a0cc-75406a517226" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:11 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:55:11 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-f99ad836-d6f7-4896-b451-61ffb51d04d4-3c38b5d8-fe65-47c9-a0cc-75406a517226" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Creating volume 3c38b5d8-fe65-47c9-a0cc-75406a517226 from snapshot f99ad836-d6f7-4896-b451-61ffb51d04d4 {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-3c38b5d8-fe65-47c9-a0cc-75406a517226" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-3c38b5d8-fe65-47c9-a0cc-75406a517226" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] snapshot: f99ad836-d6f7-4896-b451-61ffb51d04d4, volume: 3c38b5d8-fe65-47c9-a0cc-75406a517226, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5326ae-7163-4cc0-91f0-721eb0994e02]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:11 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 Jul 10 06:55:11 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:12 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.972s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:55:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:55:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:55:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:55:12 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4" returned: 0 in 1.074s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9702742f-c307-48ed-9669-180402d7fba0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:55:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:55:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:55:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[90516850-08c1-43f1-a953-85115b231c4a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:13 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 Jul 10 06:55:13 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:14 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0" returned: 0 in 1.110s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:14 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:55:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:14 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 Jul 10 06:55:14 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:21 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=35,cinder:UPDATE=14,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:55:21 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=21,cinder:SELECT=28,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:55:22 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226" returned: 0 in 8.578s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[910a9600-d5f5-4e64-b535-43b7862672ac]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:22 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 Jul 10 06:55:22 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:23 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0" returned: 0 in 1.053s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:23 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:55:23 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Converted 1024.00 MB image at 119.36 MB/s Jul 10 06:55:23 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 is being set with open permissions: ugo+rw Jul 10 06:55:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:23 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 Jul 10 06:55:23 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:24 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226" returned: 0 in 0.730s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-3c38b5d8-fe65-47c9-a0cc-75406a517226" released by "_copy_volume_from_snapshot" :: held 12.690s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-f99ad836-d6f7-4896-b451-61ffb51d04d4-3c38b5d8-fe65-47c9-a0cc-75406a517226" released by "_create_volume_from_snapshot" :: held 12.732s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.772s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e223d784-44dd-4fd5-a510-40c81d9ea212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c38b5d8-fe65-47c9-a0cc-75406a517226', 'volume_size': 2, 'snapshot_id': 'f99ad836-d6f7-4896-b451-61ffb51d04d4'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08e2a26-81e7-40c1-b606-56db87126caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:24 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Volume volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 (3c38b5d8-fe65-47c9-a0cc-75406a517226): created successfully Jul 10 06:55:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08e2a26-81e7-40c1-b606-56db87126caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Flow 'volume_create_manager' (b59cd00e-4aa4-48dc-bd40-ab5e2de135db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:55:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-04b2bdbd-a157-4b8d-aaad-2391c01268e4 tempest-VolumesSnapshotTestJSON-645064773 None] Created volume successfully. Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Flow 'volume_create_manager' (05edc6b5-24e8-46ec-a3ea-ad4949e4a55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bee1e5-7931-498f-b5c2-4bcd0ac38167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86bee1e5-7931-498f-b5c2-4bcd0ac38167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-199455862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e716dd-427f-4646-8875-f2bc9c04cc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4682e43c31654d87ae983d384b171655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:55:25Z,use_quota=True,user_id='81470afa4f084aa3bad1d28cb9d0b218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922d4b1d-bff3-415b-abe4-3aefbef9e3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922d4b1d-bff3-415b-abe4-3aefbef9e3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2ad982-deb4-4181-81b6-13554f07cecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2ad982-deb4-4181-81b6-13554f07cecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e716dd-427f-4646-8875-f2bc9c04cc88', 'volume_name': 'volume-64e716dd-427f-4646-8875-f2bc9c04cc88', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38348e72-f72c-44e2-b462-225fc5762f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38348e72-f72c-44e2-b462-225fc5762f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a05d52-3059-4518-9a46-1ee8637f0616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Volume 64e716dd-427f-4646-8875-f2bc9c04cc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e716dd-427f-4646-8875-f2bc9c04cc88', 'volume_size': 1} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-199455862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e716dd-427f-4646-8875-f2bc9c04cc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4682e43c31654d87ae983d384b171655',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:55:25Z,use_quota=True,user_id='81470afa4f084aa3bad1d28cb9d0b218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Creating volume 64e716dd-427f-4646-8875-f2bc9c04cc88 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:55:25 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:25 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88 1073741824 Jul 10 06:55:25 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-3c38b5d8-fe65-47c9-a0cc-75406a517226-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-3c38b5d8-fe65-47c9-a0cc-75406a517226-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-3c38b5d8-fe65-47c9-a0cc-75406a517226" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-3c38b5d8-fe65-47c9-a0cc-75406a517226" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[87abc0b6-eb2f-4b2b-9901-5454e1b85c5f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:26 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 Jul 10 06:55:26 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:26 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:26 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226" returned: 0 in 0.934s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88 1073741824" returned: 0 in 1.229s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:26 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226 Jul 10 06:55:26 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:27 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88 Jul 10 06:55:27 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:27 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3c38b5d8-fe65-47c9-a0cc-75406a517226" returned: 0 in 0.771s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-3c38b5d8-fe65-47c9-a0cc-75406a517226" released by "delete_volume" :: held 1.772s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Created reservations ['3f922271-4403-4d99-94b9-2546351cb176', '1c55d60a-26f3-4c03-b815-3dc9f4dd3b84', '751e9a17-5d1f-4484-91d4-5b3466d385ff', '8dae32bb-d452-45bb-a726-6f2d8664f62a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:27 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88" returned: 0 in 0.968s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.280s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:27 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:55:27 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a05d52-3059-4518-9a46-1ee8637f0616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e716dd-427f-4646-8875-f2bc9c04cc88', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933a972d-e1bd-4ebb-add2-15555188100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:27 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Volume volume-64e716dd-427f-4646-8875-f2bc9c04cc88 (64e716dd-427f-4646-8875-f2bc9c04cc88): created successfully Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (933a972d-e1bd-4ebb-add2-15555188100f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Flow 'volume_create_manager' (05edc6b5-24e8-46ec-a3ea-ad4949e4a55f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:55:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ae5550c1-3838-4dda-a5c8-34d73016a8fb tempest-TestMinimumBasicScenario-802839967 None] Created volume successfully. Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-f99ad836-d6f7-4896-b451-61ffb51d04d4-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-f99ad836-d6f7-4896-b451-61ffb51d04d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-9702742f-c307-48ed-9669-180402d7fba0" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-9702742f-c307-48ed-9669-180402d7fba0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-f99ad836-d6f7-4896-b451-61ffb51d04d4" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-f99ad836-d6f7-4896-b451-61ffb51d04d4" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Deleting offline snapshot f99ad836-d6f7-4896-b451-61ffb51d04d4 of volume 9702742f-c307-48ed-9669-180402d7fba0 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] snapshot_file for this snap is: volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[36748e51-3462-4429-8bed-4fef94988d26]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:28 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 Jul 10 06:55:28 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:28 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.081s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:28 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:55:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Deleted volume successfully. Jul 10 06:55:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41ed5731-64d3-4505-9797-83f2ac4d6488 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-3c38b5d8-fe65-47c9-a0cc-75406a517226-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:29 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4" returned: 0 in 1.168s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9702742f-c307-48ed-9669-180402d7fba0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:55:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[258995e5-c4c9-44c3-a54a-175aa228f7ec]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:29 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 Jul 10 06:55:29 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:30 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0" returned: 0 in 0.778s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:30 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 Jul 10 06:55:30 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:31 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4" returned: 0 in 0.763s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:31 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4 Jul 10 06:55:31 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:31 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0.f99ad836-d6f7-4896-b451-61ffb51d04d4" returned: 0 in 0.713s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-f99ad836-d6f7-4896-b451-61ffb51d04d4" released by "_delete_snapshot" :: held 3.550s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-9702742f-c307-48ed-9669-180402d7fba0" released by "delete_snapshot" :: held 3.582s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:31 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Created reservations ['c0b6ec06-ef8c-4897-a0c5-7bcdf0092ab6', '817000cd-2d8f-4fd2-92a3-5fabd3277131', 'ad300bbf-8263-4990-a4e7-f239185b6d9b', '9337dd52-0078-46eb-a8cb-2ae4708c207b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:55:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Delete snapshot completed successfully. Jul 10 06:55:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24a1f231-e52f-43fe-80f4-6e2af7b2b9da tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-f99ad836-d6f7-4896-b451-61ffb51d04d4-delete_snapshot" released by "delete_snapshot" :: held 3.742s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-e0e12f5d-9756-40d3-a396-1c484c3dac40 req-78df8d08-71d0-470f-9d9b-3c6259df89e3 tempest-TestMinimumBasicScenario-802839967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-e0e12f5d-9756-40d3-a396-1c484c3dac40 req-78df8d08-71d0-470f-9d9b-3c6259df89e3 tempest-TestMinimumBasicScenario-802839967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2844f0ca-2eaf-40ca-9cf1-e34f7526a24d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-e0e12f5d-9756-40d3-a396-1c484c3dac40 req-78df8d08-71d0-470f-9d9b-3c6259df89e3 tempest-TestMinimumBasicScenario-802839967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:32 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88 Jul 10 06:55:32 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-9702742f-c307-48ed-9669-180402d7fba0-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-9702742f-c307-48ed-9669-180402d7fba0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-9702742f-c307-48ed-9669-180402d7fba0" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-9702742f-c307-48ed-9669-180402d7fba0" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[75174516-039e-444d-baad-7f6d12c7b5ab]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:32 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 Jul 10 06:55:32 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:33 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-e0e12f5d-9756-40d3-a396-1c484c3dac40 req-78df8d08-71d0-470f-9d9b-3c6259df89e3 tempest-TestMinimumBasicScenario-802839967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88" returned: 0 in 0.855s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-e0e12f5d-9756-40d3-a396-1c484c3dac40 req-78df8d08-71d0-470f-9d9b-3c6259df89e3 tempest-TestMinimumBasicScenario-802839967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.878s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-e0e12f5d-9756-40d3-a396-1c484c3dac40 req-78df8d08-71d0-470f-9d9b-3c6259df89e3 tempest-TestMinimumBasicScenario-802839967 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-64e716dd-427f-4646-8875-f2bc9c04cc88', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fed9189-5a0c-40f3-9d12-9c017d91efdb', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:55:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-e0e12f5d-9756-40d3-a396-1c484c3dac40 req-78df8d08-71d0-470f-9d9b-3c6259df89e3 tempest-TestMinimumBasicScenario-802839967 None] attachment_update completed successfully. Jul 10 06:55:33 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0" returned: 0 in 0.858s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:33 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0 Jul 10 06:55:33 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:34 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9702742f-c307-48ed-9669-180402d7fba0" returned: 0 in 0.661s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-9702742f-c307-48ed-9669-180402d7fba0" released by "delete_volume" :: held 1.614s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:34 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Created reservations ['119da612-21c3-4126-9e9e-c3d4e1a417c4', 'f7e9b008-edff-460d-b3c4-2d55f63d6ea4', '87e01f58-93ab-4830-9a03-c6d7993b8c6a', 'b7dfc8f4-7991-4725-9d82-e4e7e63204d7'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:55:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:34 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:55:34 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:35 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.718s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:55:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Deleted volume successfully. Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eea16c80-8bcc-4b5a-9517-54bae86e7c75 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-9702742f-c307-48ed-9669-180402d7fba0-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Flow 'volume_create_manager' (d82e7970-a6cf-4425-8535-3698d70b6ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80dd308-c041-4b05-86a8-a8cedd90cc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80dd308-c041-4b05-86a8-a8cedd90cc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1602852191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44676c37-3f8a-4694-aedb-8999b532b906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681f5f8660cf421b9e4a563e5b2470e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:55:35Z,use_quota=True,user_id='ff10ad50513447cc9a3c5ff0fb510825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84f7b42-363c-4526-85cb-66dc8b6c258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84f7b42-363c-4526-85cb-66dc8b6c258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bd28b9-2650-4a42-af0b-2d9204800e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15bd28b9-2650-4a42-af0b-2d9204800e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44676c37-3f8a-4694-aedb-8999b532b906', 'volume_name': 'volume-44676c37-3f8a-4694-aedb-8999b532b906', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d41c8e-acc2-4879-9f93-3017762903d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d41c8e-acc2-4879-9f93-3017762903d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f69c30-6ac0-4a48-9eaa-81ffbea2f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Volume 44676c37-3f8a-4694-aedb-8999b532b906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44676c37-3f8a-4694-aedb-8999b532b906', 'volume_size': 1} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1602852191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44676c37-3f8a-4694-aedb-8999b532b906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681f5f8660cf421b9e4a563e5b2470e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:55:35Z,use_quota=True,user_id='ff10ad50513447cc9a3c5ff0fb510825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Creating volume 44676c37-3f8a-4694-aedb-8999b532b906 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:55:35 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:55:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:35 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 1073741824 Jul 10 06:55:35 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:36 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 1073741824" returned: 0 in 0.849s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:36 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 Jul 10 06:55:36 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:37 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906" returned: 0 in 0.693s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f69c30-6ac0-4a48-9eaa-81ffbea2f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44676c37-3f8a-4694-aedb-8999b532b906', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ee4e01-809a-4c8c-a720-0649d4f33bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:37 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Volume volume-44676c37-3f8a-4694-aedb-8999b532b906 (44676c37-3f8a-4694-aedb-8999b532b906): created successfully Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ee4e01-809a-4c8c-a720-0649d4f33bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Flow 'volume_create_manager' (d82e7970-a6cf-4425-8535-3698d70b6ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:55:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1936326c-c9e1-44a4-8ed1-3eaf33bbe9f7 tempest-VolumesSnapshotTestJSON-645064773 None] Created volume successfully. Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] Creating offline snapshot b5a8683e-0f7f-4dda-80e6-21ccb519e313 of volume 44676c37-3f8a-4694-aedb-8999b532b906 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa93b1d-e1c3-4978-95fc-1393d08da977]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:37 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 Jul 10 06:55:37 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:38 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906" returned: 0 in 0.829s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:38 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 1G Jul 10 06:55:38 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:39 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 1G" returned: 0 in 0.841s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44676c37-3f8a-4694-aedb-8999b532b906 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:39 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44676c37-3f8a-4694-aedb-8999b532b906 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 Jul 10 06:55:39 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:40 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44676c37-3f8a-4694-aedb-8999b532b906 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313" returned: 0 in 0.843s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:40 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 is being set with open permissions: ugo+rw Jul 10 06:55:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:40 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 Jul 10 06:55:40 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:41 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313" returned: 0 in 0.965s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:41 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.info Jul 10 06:55:41 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:42 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.info" returned: 0 in 0.936s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:42 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.info is being set with open permissions: ugo+rw Jul 10 06:55:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:42 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.info Jul 10 06:55:42 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:42 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.info" returned: 0 in 0.723s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.268s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-65a68393-897d-470f-9ec5-50da1fe327b1 tempest-VolumesSnapshotTestJSON-645064773 None] Create snapshot completed successfully Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Flow 'volume_create_manager' (d7d37d72-d4a3-4870-a4d9-3a48a5ca2511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bbb313-91d4-4138-a1bc-627ae910e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bbb313-91d4-4138-a1bc-627ae910e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1372721739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84420cca-7dca-4b62-b6fc-0263cb14b432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='681f5f8660cf421b9e4a563e5b2470e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5a8683e-0f7f-4dda-80e6-21ccb519e313,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:55:45Z,use_quota=True,user_id='ff10ad50513447cc9a3c5ff0fb510825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef83351-de53-47ba-b00a-46685cd32334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef83351-de53-47ba-b00a-46685cd32334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4b92d8-a244-4f06-80c8-cf68644a78cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4b92d8-a244-4f06-80c8-cf68644a78cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84420cca-7dca-4b62-b6fc-0263cb14b432', 'volume_name': 'volume-84420cca-7dca-4b62-b6fc-0263cb14b432', 'volume_size': 1, 'snapshot_id': 'b5a8683e-0f7f-4dda-80e6-21ccb519e313'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7133f02-9cc3-489c-af22-81e59e861dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7133f02-9cc3-489c-af22-81e59e861dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ab86fd-0502-4ecf-be02-32cd90ed671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:44 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Volume 84420cca-7dca-4b62-b6fc-0263cb14b432: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84420cca-7dca-4b62-b6fc-0263cb14b432', 'volume_size': 1, 'snapshot_id': 'b5a8683e-0f7f-4dda-80e6-21ccb519e313'} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-b5a8683e-0f7f-4dda-80e6-21ccb519e313-84420cca-7dca-4b62-b6fc-0263cb14b432" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-b5a8683e-0f7f-4dda-80e6-21ccb519e313-84420cca-7dca-4b62-b6fc-0263cb14b432" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Creating volume 84420cca-7dca-4b62-b6fc-0263cb14b432 from snapshot b5a8683e-0f7f-4dda-80e6-21ccb519e313 {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-84420cca-7dca-4b62-b6fc-0263cb14b432" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-84420cca-7dca-4b62-b6fc-0263cb14b432" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] snapshot: b5a8683e-0f7f-4dda-80e6-21ccb519e313, volume: 84420cca-7dca-4b62-b6fc-0263cb14b432, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[80312fb5-fa34-4cc7-86b2-45593247b259]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:44 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 Jul 10 06:55:44 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:45 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313" returned: 0 in 0.769s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44676c37-3f8a-4694-aedb-8999b532b906(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:55:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:55:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:55:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ca9997-c6f5-4b7a-b8b3-5022bf3939e9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:45 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 Jul 10 06:55:45 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:46 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:46 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:55:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:46 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432 Jul 10 06:55:46 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:51 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432" returned: 0 in 4.865s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:51 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa07ec5d-5586-44d0-85ae-6af0302d7e61]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:51 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 Jul 10 06:55:51 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:52 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906" returned: 0 in 1.044s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:52 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:55:52 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Converted 1024.00 MB image at 210.41 MB/s Jul 10 06:55:52 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432 is being set with open permissions: ugo+rw Jul 10 06:55:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:52 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432 Jul 10 06:55:52 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:52 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432" returned: 0 in 0.697s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-84420cca-7dca-4b62-b6fc-0263cb14b432" released by "_copy_volume_from_snapshot" :: held 8.235s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-b5a8683e-0f7f-4dda-80e6-21ccb519e313-84420cca-7dca-4b62-b6fc-0263cb14b432" released by "_create_volume_from_snapshot" :: held 8.265s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.280s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ab86fd-0502-4ecf-be02-32cd90ed671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84420cca-7dca-4b62-b6fc-0263cb14b432', 'volume_size': 1, 'snapshot_id': 'b5a8683e-0f7f-4dda-80e6-21ccb519e313'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d045f8-3599-4080-a994-b081a6a11f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Volume volume-84420cca-7dca-4b62-b6fc-0263cb14b432 (84420cca-7dca-4b62-b6fc-0263cb14b432): created successfully Jul 10 06:55:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d045f8-3599-4080-a994-b081a6a11f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Flow 'volume_create_manager' (d7d37d72-d4a3-4870-a4d9-3a48a5ca2511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:55:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2d83e29f-4eb8-41a9-98ba-a30e0911e961 tempest-VolumesSnapshotTestJSON-645064773 None] Created volume successfully. Jul 10 06:55:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-84420cca-7dca-4b62-b6fc-0263cb14b432-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-84420cca-7dca-4b62-b6fc-0263cb14b432-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-84420cca-7dca-4b62-b6fc-0263cb14b432" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-84420cca-7dca-4b62-b6fc-0263cb14b432" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afc3889-8865-480d-81c4-14eb48d70acd]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:53 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432 Jul 10 06:55:53 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:54 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432" returned: 0 in 0.941s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:54 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432 Jul 10 06:55:54 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:55 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-84420cca-7dca-4b62-b6fc-0263cb14b432" returned: 0 in 0.922s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-84420cca-7dca-4b62-b6fc-0263cb14b432" released by "delete_volume" :: held 1.916s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Created reservations ['ae55ad41-9bda-43d8-b451-f5bee0b03d99', '594fbc23-fa04-411a-a182-a182c5a6dd99', 'fb1dc206-3409-437f-bed0-0f87a5b14a8f', '5a65e403-d61b-4d2c-b103-53bc4b39c8d6'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:55 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:55:55 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-b5a8683e-0f7f-4dda-80e6-21ccb519e313-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-b5a8683e-0f7f-4dda-80e6-21ccb519e313-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-44676c37-3f8a-4694-aedb-8999b532b906" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-44676c37-3f8a-4694-aedb-8999b532b906" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-b5a8683e-0f7f-4dda-80e6-21ccb519e313" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-b5a8683e-0f7f-4dda-80e6-21ccb519e313" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Deleting offline snapshot b5a8683e-0f7f-4dda-80e6-21ccb519e313 of volume 44676c37-3f8a-4694-aedb-8999b532b906 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] snapshot_file for this snap is: volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[91034e3a-2192-4398-b3aa-c6ca5d2b01d2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:55 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 Jul 10 06:55:55 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:56 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.693s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:56 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:55:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Deleted volume successfully. Jul 10 06:55:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-83f5c148-c479-490b-a7f9-10c4afd262ef tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-84420cca-7dca-4b62-b6fc-0263cb14b432-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-a87ba207-1cbd-4492-899f-69317cc678cf tempest-TestShelveInstance-1851196865 None] Terminate volume connection completed successfully. Jul 10 06:55:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-a87ba207-1cbd-4492-899f-69317cc678cf tempest-TestShelveInstance-1851196865 None] Deleting attachment 31f58db1-78b8-4588-ae0a-a1ff37ee9e7c. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:55:56 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313" returned: 0 in 0.828s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44676c37-3f8a-4694-aedb-8999b532b906(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:55:56 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35d8c69-836b-4ae9-a514-037d17f03d02]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:56 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 Jul 10 06:55:56 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Acquiring lock "cinder-2ba981de-c800-4729-8bcd-088b8f86b912-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Lock "cinder-2ba981de-c800-4729-8bcd-088b8f86b912-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Acquiring lock "cinder-quobyte-2ba981de-c800-4729-8bcd-088b8f86b912" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Lock "cinder-quobyte-2ba981de-c800-4729-8bcd-088b8f86b912" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a45536-8781-4d21-8d85-4a7acce67529]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:57 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 Jul 10 06:55:57 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:57 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906" returned: 0 in 0.832s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:57 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 Jul 10 06:55:57 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:58 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912" returned: 0 in 0.840s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:58 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313" returned: 0 in 0.796s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:58 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 Jul 10 06:55:58 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:58 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313 Jul 10 06:55:58 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:59 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906.b5a8683e-0f7f-4dda-80e6-21ccb519e313" returned: 0 in 0.837s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:59 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912" returned: 1 in 0.982s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-b5a8683e-0f7f-4dda-80e6-21ccb519e313" released by "_delete_snapshot" :: held 3.419s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-44676c37-3f8a-4694-aedb-8999b532b906" released by "delete_snapshot" :: held 3.443s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:59 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912 Jul 10 06:55:59 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:59 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Created reservations ['543e6f7f-3149-4b1c-a589-76eb6ebe49b4', '0e8b7502-3729-463e-a86e-34cf1931188c', '5d958452-6915-4a7e-8df0-c901b22d572c', '61dc01cc-90f4-4384-80dc-0220264da41c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:55:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Delete snapshot completed successfully. Jul 10 06:55:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5578c0d1-3752-42cc-afc7-392369c87fe4 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-b5a8683e-0f7f-4dda-80e6-21ccb519e313-delete_snapshot" released by "delete_snapshot" :: held 3.594s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:59 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2ba981de-c800-4729-8bcd-088b8f86b912" returned: 0 in 0.770s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Lock "cinder-quobyte-2ba981de-c800-4729-8bcd-088b8f86b912" released by "delete_volume" :: held 2.693s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG cinder.quota [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Created reservations ['3388bad0-0c9f-4f18-b5df-202aedc25488', '0294bb04-7d6d-46a8-afcb-e3eb6650622a', '34e5db44-6846-4370-aedd-a68b7aad61f4', 'e92b18e7-2155-434a-a93c-90b0c6aa0780'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-44676c37-3f8a-4694-aedb-8999b532b906-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-44676c37-3f8a-4694-aedb-8999b532b906-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:00 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:56:00 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-44676c37-3f8a-4694-aedb-8999b532b906" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-44676c37-3f8a-4694-aedb-8999b532b906" acquired by "delete_volume" :: waited 0.049s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9464d17-ba3d-4054-a5eb-bb4942f05bd7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:00 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 Jul 10 06:56:00 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:01 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.938s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:01 devstack cinder-volume[86966]: DEBUG cinder.manager [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Deleted volume successfully. Jul 10 06:56:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [req-4aef6eac-2ee3-4729-87b2-271a4769517d req-c4520cf2-ad75-4f67-a9af-5ab528e10fee tempest-TestShelveInstance-1851196865 None] Lock "cinder-2ba981de-c800-4729-8bcd-088b8f86b912-delete_volume" released by "delete_volume" :: held 3.946s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:01 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906" returned: 0 in 1.134s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:01 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906 Jul 10 06:56:01 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:02 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-44676c37-3f8a-4694-aedb-8999b532b906" returned: 0 in 0.802s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-44676c37-3f8a-4694-aedb-8999b532b906" released by "delete_volume" :: held 2.077s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:02 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Created reservations ['8a8295a9-7efe-4926-b03a-c03bba9739aa', 'bd48111c-d0f8-4a1c-9033-a7d78ee8a23c', '7e5fe816-9dee-4df9-a921-34c167809079', '0c9ebbd7-0f0e-40c0-8b67-87169cd01595'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:02 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:56:02 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:03 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.722s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:03 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Deleted volume successfully. Jul 10 06:56:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4861a535-592d-46ff-93d4-4d6ad77c8f22 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-44676c37-3f8a-4694-aedb-8999b532b906-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-c3f080d3-d6f7-420d-a191-92a498ff67fe-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-c3f080d3-d6f7-420d-a191-92a498ff67fe-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "cinder-quobyte-c3f080d3-d6f7-420d-a191-92a498ff67fe" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-c3f080d3-d6f7-420d-a191-92a498ff67fe" acquired by "delete_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2335f94-2605-43fd-9182-b75fdc827a2d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:04 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe Jul 10 06:56:04 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:04 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe" returned: 0 in 0.880s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:04 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe Jul 10 06:56:04 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:05 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c3f080d3-d6f7-420d-a191-92a498ff67fe" returned: 0 in 0.669s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-quobyte-c3f080d3-d6f7-420d-a191-92a498ff67fe" released by "delete_volume" :: held 1.618s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:05 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Created reservations ['e090cb17-d834-440a-8a1d-89ab227a9412', 'd8e2cf55-a0db-4fd4-b375-b68e7f154010', '23ec350c-2525-4a94-8821-51b27d2f65e0', '7296a387-c284-40d4-8ca0-11ada30edf3d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:56:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:05 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:56:05 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:06 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.725s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:06 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Deleted volume successfully. Jul 10 06:56:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-339e1fc5-ef5c-46d0-bf08-bbda335ef610 tempest-VolumesSnapshotTestJSON-645064773 None] Lock "cinder-c3f080d3-d6f7-420d-a191-92a498ff67fe-delete_volume" released by "delete_volume" :: held 2.716s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:56:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:11 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:56:11 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:12 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.835s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:56:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:56:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:56:15 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=67,cinder:UPDATE=68,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:56:16 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=75,cinder:DELETE=8,cinder:SELECT=49,cinder:INSERT=20 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:56:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-9d0406a7-b3f1-4c69-b1ac-09da5b51aa9d req-378629b4-0370-4423-a2cc-76ed6ae4625b tempest-TestMinimumBasicScenario-802839967 None] Terminate volume connection completed successfully. Jul 10 06:56:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-9d0406a7-b3f1-4c69-b1ac-09da5b51aa9d req-378629b4-0370-4423-a2cc-76ed6ae4625b tempest-TestMinimumBasicScenario-802839967 None] Deleting attachment 8fed9189-5a0c-40f3-9d12-9c017d91efdb. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:56:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Acquiring lock "cinder-64e716dd-427f-4646-8875-f2bc9c04cc88-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Lock "cinder-64e716dd-427f-4646-8875-f2bc9c04cc88-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Acquiring lock "cinder-quobyte-64e716dd-427f-4646-8875-f2bc9c04cc88" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Lock "cinder-quobyte-64e716dd-427f-4646-8875-f2bc9c04cc88" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eda428-796d-4b90-be49-cae77142a9bf]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:26 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88 Jul 10 06:56:26 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:27 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88" returned: 0 in 0.889s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:27 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88 Jul 10 06:56:27 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:28 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-64e716dd-427f-4646-8875-f2bc9c04cc88" returned: 0 in 0.665s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Lock "cinder-quobyte-64e716dd-427f-4646-8875-f2bc9c04cc88" released by "delete_volume" :: held 1.594s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:28 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Created reservations ['530eb319-4814-43cc-aed5-e8ddd716e97f', 'c485de47-9b23-47f0-9441-c07f83716900', 'af286d30-443b-476f-bfb8-170cb352e3d3', '06707f77-2cf7-40f1-a0da-c15db440ccb1'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:56:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:28 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:56:28 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:29 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.827s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:29 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Deleted volume successfully. Jul 10 06:56:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4b43db3f-65d8-4e7a-a943-6ad776467ab1 tempest-TestMinimumBasicScenario-802839967 None] Lock "cinder-64e716dd-427f-4646-8875-f2bc9c04cc88-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:38 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:56:39 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:56:54 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:56:54 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Flow 'volume_create_manager' (9fe58557-5cea-46e8-a998-6604c5928c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4555668b-0c20-4071-8e89-b3012db45d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4555668b-0c20-4071-8e89-b3012db45d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-149536879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8c9fa6-a652-4b99-aa2d-428f9945f980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757c3c6077b3437793d5f6898e996012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:07Z,use_quota=True,user_id='e807dfcb2b4e4c9e8fac360716366fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ccf54a-8474-4dd7-9499-c6c5cf379a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ccf54a-8474-4dd7-9499-c6c5cf379a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5df1a66-0401-499f-a965-0a32e40a6b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5df1a66-0401-499f-a965-0a32e40a6b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8c9fa6-a652-4b99-aa2d-428f9945f980', 'volume_name': 'volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751a7484-a8a1-49a8-947a-a14e54b72321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751a7484-a8a1-49a8-947a-a14e54b72321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578e0901-3a47-439c-96f3-56bbd9deb29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Volume 0d8c9fa6-a652-4b99-aa2d-428f9945f980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980', 'volume_size': 1} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-149536879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8c9fa6-a652-4b99-aa2d-428f9945f980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757c3c6077b3437793d5f6898e996012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:07Z,use_quota=True,user_id='e807dfcb2b4e4c9e8fac360716366fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Creating volume 0d8c9fa6-a652-4b99-aa2d-428f9945f980 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:06 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:57:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:06 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 1073741824 Jul 10 06:57:06 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Flow 'volume_create_manager' (9016b393-ab16-47de-9357-b7044841bd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16eb1b41-4826-49f8-a82c-41db2c1f0d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16eb1b41-4826-49f8-a82c-41db2c1f0d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-967867061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02b76a6-1cce-48c1-940b-7591bab063e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757c3c6077b3437793d5f6898e996012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:07Z,use_quota=True,user_id='e807dfcb2b4e4c9e8fac360716366fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d19806-2cae-4312-b5d8-1ed1f3f4699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d19806-2cae-4312-b5d8-1ed1f3f4699c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7309a1-b41d-489b-aa18-21cc3a8b9504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7309a1-b41d-489b-aa18-21cc3a8b9504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02b76a6-1cce-48c1-940b-7591bab063e2', 'volume_name': 'volume-e02b76a6-1cce-48c1-940b-7591bab063e2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb41a62-e708-4d8e-bbd2-aa69eacb29f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb41a62-e708-4d8e-bbd2-aa69eacb29f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfceb15-0233-47a6-807a-0df267ff777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Volume e02b76a6-1cce-48c1-940b-7591bab063e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02b76a6-1cce-48c1-940b-7591bab063e2', 'volume_size': 1} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:07 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 1073741824" returned: 0 in 0.894s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:07 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 Jul 10 06:57:07 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:08 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980" returned: 0 in 0.740s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.301s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-967867061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02b76a6-1cce-48c1-940b-7591bab063e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757c3c6077b3437793d5f6898e996012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:07Z,use_quota=True,user_id='e807dfcb2b4e4c9e8fac360716366fb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Creating volume e02b76a6-1cce-48c1-940b-7591bab063e2 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:08 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578e0901-3a47-439c-96f3-56bbd9deb29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:08 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2 1073741824 Jul 10 06:57:08 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340de5b1-4530-4e8f-8f1e-bc06591083fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:08 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Volume volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 (0d8c9fa6-a652-4b99-aa2d-428f9945f980): created successfully Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340de5b1-4530-4e8f-8f1e-bc06591083fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Flow 'volume_create_manager' (9fe58557-5cea-46e8-a998-6604c5928c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a2c5cd26-e908-49fa-b51f-17f93cdc4c99 tempest-TestServerVolumeAttachmentScenario-386288994 None] Created volume successfully. Jul 10 06:57:09 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2 1073741824" returned: 0 in 1.005s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:09 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2 Jul 10 06:57:09 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:10 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2" returned: 0 in 0.695s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfceb15-0233-47a6-807a-0df267ff777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02b76a6-1cce-48c1-940b-7591bab063e2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58d3c83-2437-4687-8467-ca54e5094668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:10 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Volume volume-e02b76a6-1cce-48c1-940b-7591bab063e2 (e02b76a6-1cce-48c1-940b-7591bab063e2): created successfully Jul 10 06:57:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e58d3c83-2437-4687-8467-ca54e5094668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Flow 'volume_create_manager' (9016b393-ab16-47de-9357-b7044841bd1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9cf93bb8-0295-49e8-8065-dc154d4911a7 tempest-TestServerVolumeAttachmentScenario-386288994 None] Created volume successfully. Jul 10 06:57:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:57:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:11 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:57:11 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:12 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.689s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:57:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:57:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Flow 'volume_create_manager' (c546ca62-6c5b-44bd-a3d7-285481c0078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b084bcd-10da-4a5e-b5fc-435a7e715b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b084bcd-10da-4a5e-b5fc-435a7e715b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-140114124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9361efed-77bb-4c44-bfec-d4fbd660db99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e91da84b63d40d2bd8a3a0ab493718c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:18Z,use_quota=True,user_id='914d850d3c3e4059878c617261f75283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030bd975-36ab-4cd7-bd32-17185eb90f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030bd975-36ab-4cd7-bd32-17185eb90f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a840e2a2-0d30-4b0d-b779-e8ef0d21cdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a840e2a2-0d30-4b0d-b779-e8ef0d21cdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9361efed-77bb-4c44-bfec-d4fbd660db99', 'volume_name': 'volume-9361efed-77bb-4c44-bfec-d4fbd660db99', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e54747-ab44-4cc3-9561-d33289bc8bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e54747-ab44-4cc3-9561-d33289bc8bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61cd54e0-24d8-4fc3-8544-7806bf67e7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Volume 9361efed-77bb-4c44-bfec-d4fbd660db99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9361efed-77bb-4c44-bfec-d4fbd660db99', 'volume_size': 1} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-140114124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9361efed-77bb-4c44-bfec-d4fbd660db99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e91da84b63d40d2bd8a3a0ab493718c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:18Z,use_quota=True,user_id='914d850d3c3e4059878c617261f75283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Creating volume 9361efed-77bb-4c44-bfec-d4fbd660db99 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:17 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:57:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:18 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99 1073741824 Jul 10 06:57:18 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:18 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99 1073741824" returned: 0 in 0.879s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:18 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99 Jul 10 06:57:18 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:19 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99" returned: 0 in 0.702s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61cd54e0-24d8-4fc3-8544-7806bf67e7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9361efed-77bb-4c44-bfec-d4fbd660db99', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c92b94-ff46-44dc-8626-f7fac9b19b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:19 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Volume volume-9361efed-77bb-4c44-bfec-d4fbd660db99 (9361efed-77bb-4c44-bfec-d4fbd660db99): created successfully Jul 10 06:57:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c92b94-ff46-44dc-8626-f7fac9b19b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Flow 'volume_create_manager' (c546ca62-6c5b-44bd-a3d7-285481c0078f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:19 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8901a851-0ae5-40b6-9691-f5eed4bb6058 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Created volume successfully. Jul 10 06:57:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b10a1b10-e281-4ebb-b95c-46a068d9dc50 req-1b6bc71a-ee4b-4201-93ab-7b9ff9b21a61 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b10a1b10-e281-4ebb-b95c-46a068d9dc50 req-1b6bc71a-ee4b-4201-93ab-7b9ff9b21a61 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f85b112-1183-43f7-9d16-9b7e02a5cc1c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b10a1b10-e281-4ebb-b95c-46a068d9dc50 req-1b6bc71a-ee4b-4201-93ab-7b9ff9b21a61 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:23 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99 Jul 10 06:57:23 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:24 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-b10a1b10-e281-4ebb-b95c-46a068d9dc50 req-1b6bc71a-ee4b-4201-93ab-7b9ff9b21a61 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99" returned: 0 in 0.984s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-b10a1b10-e281-4ebb-b95c-46a068d9dc50 req-1b6bc71a-ee4b-4201-93ab-7b9ff9b21a61 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-b10a1b10-e281-4ebb-b95c-46a068d9dc50 req-1b6bc71a-ee4b-4201-93ab-7b9ff9b21a61 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-9361efed-77bb-4c44-bfec-d4fbd660db99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13d450f8-bbbe-4bb3-8a1c-4573cf1cbacd', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:57:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-b10a1b10-e281-4ebb-b95c-46a068d9dc50 req-1b6bc71a-ee4b-4201-93ab-7b9ff9b21a61 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] attachment_update completed successfully. Jul 10 06:57:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-3966166c-819b-4b8b-856a-130630e5d664 req-fc882c07-1854-4e85-a0b6-333334fad714 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Terminate volume connection completed successfully. Jul 10 06:57:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-3966166c-819b-4b8b-856a-130630e5d664 req-fc882c07-1854-4e85-a0b6-333334fad714 tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Deleting attachment 13d450f8-bbbe-4bb3-8a1c-4573cf1cbacd. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:57:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Acquiring lock "cinder-9361efed-77bb-4c44-bfec-d4fbd660db99-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "cinder-9361efed-77bb-4c44-bfec-d4fbd660db99-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Acquiring lock "cinder-quobyte-9361efed-77bb-4c44-bfec-d4fbd660db99" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "cinder-quobyte-9361efed-77bb-4c44-bfec-d4fbd660db99" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f02950f-ea21-4012-b8ca-f122ec3b7320]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:33 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99 Jul 10 06:57:33 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:34 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99" returned: 0 in 0.818s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:34 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99 Jul 10 06:57:34 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:35 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9361efed-77bb-4c44-bfec-d4fbd660db99" returned: 0 in 0.697s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "cinder-quobyte-9361efed-77bb-4c44-bfec-d4fbd660db99" released by "delete_volume" :: held 1.553s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:35 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Created reservations ['c26bb25c-0b55-457c-9b74-fb083fa42a77', '91ca824f-f5ed-49ee-8618-68f814bb0f09', 'abf0aca3-ada6-4ab0-b020-f42b8294b4b3', 'd902c519-f7fd-4904-8be6-8e38048ef8d6'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:35 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:57:35 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:36 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.679s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:36 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Deleted volume successfully. Jul 10 06:57:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-75e8fe59-a4de-47b6-86d4-bb1b1013e13c tempest-TestServerVolumeAttachScenarioOldVersion-2005187219 None] Lock "cinder-9361efed-77bb-4c44-bfec-d4fbd660db99-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:45 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=19,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:57:46 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=21,cinder:SELECT=16,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:57:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ac1714d4-bf9e-4d74-a602-38b667396953 req-72b70a4d-3635-49da-a844-871baa0266ef tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ac1714d4-bf9e-4d74-a602-38b667396953 req-72b70a4d-3635-49da-a844-871baa0266ef tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d7ea38-cb03-443c-aa37-b8c074595d50]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-ac1714d4-bf9e-4d74-a602-38b667396953 req-72b70a4d-3635-49da-a844-871baa0266ef tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:49 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 Jul 10 06:57:49 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:49 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-ac1714d4-bf9e-4d74-a602-38b667396953 req-72b70a4d-3635-49da-a844-871baa0266ef tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980" returned: 0 in 0.846s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-ac1714d4-bf9e-4d74-a602-38b667396953 req-72b70a4d-3635-49da-a844-871baa0266ef tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:49 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-ac1714d4-bf9e-4d74-a602-38b667396953 req-72b70a4d-3635-49da-a844-871baa0266ef tempest-TestServerVolumeAttachmentScenario-386288994 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '218bb0a4-b2aa-4254-8a3d-5b6834cfaaec', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:57:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-ac1714d4-bf9e-4d74-a602-38b667396953 req-72b70a4d-3635-49da-a844-871baa0266ef tempest-TestServerVolumeAttachmentScenario-386288994 None] attachment_update completed successfully. Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Flow 'volume_create_manager' (3bd21048-c712-4ff0-bd4a-74e35aa4501d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41dd4e66-44b4-4362-b202-8d8af5095a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41dd4e66-44b4-4362-b202-8d8af5095a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809702847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ebb57d-2ce8-43e2-a614-b4d100829f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a64b3d8ff04de9b55d18291fb9daf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:56Z,use_quota=True,user_id='a524967fdf0a4c02acefda63523ca809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0be5a2-4dfa-477e-aa03-1e4227891aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0be5a2-4dfa-477e-aa03-1e4227891aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1820d6b1-db73-4024-943c-32fb82ceca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1820d6b1-db73-4024-943c-32fb82ceca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ebb57d-2ce8-43e2-a614-b4d100829f46', 'volume_name': 'volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d318b6ba-e4f9-4a9f-ae71-6803df2a3ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d318b6ba-e4f9-4a9f-ae71-6803df2a3ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e0b483-8713-4ea3-9b07-dc6384a69d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:55 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Volume a2ebb57d-2ce8-43e2-a614-b4d100829f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46', 'volume_size': 1} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809702847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ebb57d-2ce8-43e2-a614-b4d100829f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a64b3d8ff04de9b55d18291fb9daf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:56Z,use_quota=True,user_id='a524967fdf0a4c02acefda63523ca809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Creating volume a2ebb57d-2ce8-43e2-a614-b4d100829f46 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:55 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:57:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:55 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46 1073741824 Jul 10 06:57:55 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Flow 'volume_create_manager' (ed3a55af-824d-415c-aa64-5d76b455367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e617165a-e254-447b-8081-378f5d248440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e617165a-e254-447b-8081-378f5d248440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1329998222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0053ad75-689e-41ee-a03e-3cee1a09d1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a64b3d8ff04de9b55d18291fb9daf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:56Z,use_quota=True,user_id='a524967fdf0a4c02acefda63523ca809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc800258-7a7d-4175-ad8b-6a32f4cd52c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc800258-7a7d-4175-ad8b-6a32f4cd52c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1c5cc7-68a0-42d6-b721-5bb8eb5a3d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1c5cc7-68a0-42d6-b721-5bb8eb5a3d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0053ad75-689e-41ee-a03e-3cee1a09d1a4', 'volume_name': 'volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f99abe6-2c28-4298-9a53-03292c8f0305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f99abe6-2c28-4298-9a53-03292c8f0305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1979fd77-1ae0-4b0f-a8fe-781e2df4bafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:56 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Volume 0053ad75-689e-41ee-a03e-3cee1a09d1a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4', 'volume_size': 1} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Flow 'volume_create_manager' (e131557f-a453-4868-b007-3ee7af5b6b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27df7feb-0e07-4689-8aa4-f9132842ca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27df7feb-0e07-4689-8aa4-f9132842ca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-79882018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a64b3d8ff04de9b55d18291fb9daf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:57Z,use_quota=True,user_id='a524967fdf0a4c02acefda63523ca809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d7e3cc-88b8-4074-83e9-67c252be20c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d7e3cc-88b8-4074-83e9-67c252be20c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bcb68f-1e33-499c-b66e-b7aa0779762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bcb68f-1e33-499c-b66e-b7aa0779762c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6', 'volume_name': 'volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e13232-3953-4d2b-8e57-dc30140dabaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e13232-3953-4d2b-8e57-dc30140dabaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8b9003-a532-4815-8f5e-e59eb11f739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:56 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Volume 01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6', 'volume_size': 1} Jul 10 06:57:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:57 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46 1073741824" returned: 0 in 1.154s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:57 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46 Jul 10 06:57:57 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Flow 'volume_create_manager' (6f347c44-68e1-4245-ae3d-b5b968780f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddff8159-1b15-497e-86db-4fb726351273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddff8159-1b15-497e-86db-4fb726351273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-757640833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3193ea72-125c-4c48-ae78-7f1ada8ef917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a64b3d8ff04de9b55d18291fb9daf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:57Z,use_quota=True,user_id='a524967fdf0a4c02acefda63523ca809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38dfd757-a817-4bf6-934f-bf524c90b4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38dfd757-a817-4bf6-934f-bf524c90b4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e17de21-f0c2-4155-9513-de73480a3c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e17de21-f0c2-4155-9513-de73480a3c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3193ea72-125c-4c48-ae78-7f1ada8ef917', 'volume_name': 'volume-3193ea72-125c-4c48-ae78-7f1ada8ef917', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d635bff4-3691-4ca8-9ce5-9e57ab0e172c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d635bff4-3691-4ca8-9ce5-9e57ab0e172c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579145ee-39c6-488b-8c07-2e1e3e9c3adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Volume 3193ea72-125c-4c48-ae78-7f1ada8ef917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3193ea72-125c-4c48-ae78-7f1ada8ef917', 'volume_size': 1} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Flow 'volume_create_manager' (5c87b6fb-2649-48ec-b2d7-c35c8223c53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff0cce2-237c-4f1a-a2fe-ef087fc788f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff0cce2-237c-4f1a-a2fe-ef087fc788f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1267638663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f09e463-e0bf-4978-9019-ae58a959747c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a64b3d8ff04de9b55d18291fb9daf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:57Z,use_quota=True,user_id='a524967fdf0a4c02acefda63523ca809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24f13ee-ef24-4cad-bdd1-fae9ec2ebaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d24f13ee-ef24-4cad-bdd1-fae9ec2ebaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916e14c3-f541-4409-8b63-dff10cedaef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916e14c3-f541-4409-8b63-dff10cedaef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f09e463-e0bf-4978-9019-ae58a959747c', 'volume_name': 'volume-6f09e463-e0bf-4978-9019-ae58a959747c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9297ccc3-2ec1-4b3a-9ca0-ef96f3236542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9297ccc3-2ec1-4b3a-9ca0-ef96f3236542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037ac4be-019b-40d5-9232-bdf2cf3969cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Volume 6f09e463-e0bf-4978-9019-ae58a959747c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f09e463-e0bf-4978-9019-ae58a959747c', 'volume_size': 1} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:57 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46" returned: 0 in 0.755s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1329998222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0053ad75-689e-41ee-a03e-3cee1a09d1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a64b3d8ff04de9b55d18291fb9daf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:56Z,use_quota=True,user_id='a524967fdf0a4c02acefda63523ca809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Creating volume 0053ad75-689e-41ee-a03e-3cee1a09d1a4 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:57 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:57 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4 1073741824 Jul 10 06:57:57 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e0b483-8713-4ea3-9b07-dc6384a69d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13184765-7415-412b-a0b0-5d5766aaafe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Volume volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46 (a2ebb57d-2ce8-43e2-a614-b4d100829f46): created successfully Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13184765-7415-412b-a0b0-5d5766aaafe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Flow 'volume_create_manager' (3bd21048-c712-4ff0-bd4a-74e35aa4501d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7746e5a4-9d9b-4dc3-b194-1378a326e066 tempest-CreateVolumesFromImageTest-1000302987 None] Created volume successfully. Jul 10 06:57:58 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4 1073741824" returned: 0 in 0.836s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:58 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4 Jul 10 06:57:58 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:59 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4" returned: 0 in 0.668s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.573s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-79882018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a64b3d8ff04de9b55d18291fb9daf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:57Z,use_quota=True,user_id='a524967fdf0a4c02acefda63523ca809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Creating volume 01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:59 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1979fd77-1ae0-4b0f-a8fe-781e2df4bafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866826ba-4734-4b94-b3d0-22f694a22900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:59 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6 1073741824 Jul 10 06:57:59 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:59 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Volume volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4 (0053ad75-689e-41ee-a03e-3cee1a09d1a4): created successfully Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866826ba-4734-4b94-b3d0-22f694a22900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Flow 'volume_create_manager' (ed3a55af-824d-415c-aa64-5d76b455367a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0df02da6-ff16-45b9-bc3b-56d7074bbff5 tempest-CreateVolumesFromImageTest-1000302987 None] Created volume successfully. Jul 10 06:57:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-20f128b9-95f1-4a57-8e12-398cc11959b3 req-d7d2f988-7bba-40cc-bac6-9034785e2629 tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:00 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6 1073741824" returned: 0 in 0.841s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:00 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6 Jul 10 06:58:00 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:00 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6" returned: 0 in 0.672s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.712s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-757640833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3193ea72-125c-4c48-ae78-7f1ada8ef917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a64b3d8ff04de9b55d18291fb9daf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:57Z,use_quota=True,user_id='a524967fdf0a4c02acefda63523ca809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Creating volume 3193ea72-125c-4c48-ae78-7f1ada8ef917 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:00 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:58:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:01 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917 1073741824 Jul 10 06:58:01 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8b9003-a532-4815-8f5e-e59eb11f739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4311c3-60fd-4032-a92d-713459bd7e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:01 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Volume volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6 (01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6): created successfully Jul 10 06:58:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4311c3-60fd-4032-a92d-713459bd7e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Flow 'volume_create_manager' (e131557f-a453-4868-b007-3ee7af5b6b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c58d3ae4-4a5c-4a43-8fcf-695d008b6282 tempest-CreateVolumesFromImageTest-1000302987 None] Created volume successfully. Jul 10 06:58:01 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917 1073741824" returned: 0 in 0.886s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:01 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917 Jul 10 06:58:01 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:02 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917" returned: 0 in 0.684s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.980s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1267638663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f09e463-e0bf-4978-9019-ae58a959747c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a64b3d8ff04de9b55d18291fb9daf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:57Z,use_quota=True,user_id='a524967fdf0a4c02acefda63523ca809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Creating volume 6f09e463-e0bf-4978-9019-ae58a959747c {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:02 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:02 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c 1073741824 Jul 10 06:58:02 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579145ee-39c6-488b-8c07-2e1e3e9c3adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3193ea72-125c-4c48-ae78-7f1ada8ef917', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255a26df-818d-45be-aa1f-98a42472b5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Volume volume-3193ea72-125c-4c48-ae78-7f1ada8ef917 (3193ea72-125c-4c48-ae78-7f1ada8ef917): created successfully Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255a26df-818d-45be-aa1f-98a42472b5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Flow 'volume_create_manager' (6f347c44-68e1-4245-ae3d-b5b968780f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b61ff971-a92c-4949-9ea3-de5af7ff6580 tempest-CreateVolumesFromImageTest-1000302987 None] Created volume successfully. Jul 10 06:58:03 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c 1073741824" returned: 0 in 0.883s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:03 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c Jul 10 06:58:03 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:04 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-20f128b9-95f1-4a57-8e12-398cc11959b3 req-d7d2f988-7bba-40cc-bac6-9034785e2629 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.433s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037ac4be-019b-40d5-9232-bdf2cf3969cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f09e463-e0bf-4978-9019-ae58a959747c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91057d18-da59-4bb1-8f82-b51c97eacb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7277f971-b744-4eba-92e3-d2719304b417]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-20f128b9-95f1-4a57-8e12-398cc11959b3 req-d7d2f988-7bba-40cc-bac6-9034785e2629 tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Volume volume-6f09e463-e0bf-4978-9019-ae58a959747c (6f09e463-e0bf-4978-9019-ae58a959747c): created successfully Jul 10 06:58:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91057d18-da59-4bb1-8f82-b51c97eacb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Flow 'volume_create_manager' (5c87b6fb-2649-48ec-b2d7-c35c8223c53c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-044c8b79-cc32-4c02-a619-8d30fae3d9a3 tempest-CreateVolumesFromImageTest-1000302987 None] Created volume successfully. Jul 10 06:58:04 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2 Jul 10 06:58:04 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:05 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-20f128b9-95f1-4a57-8e12-398cc11959b3 req-d7d2f988-7bba-40cc-bac6-9034785e2629 tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2" returned: 0 in 0.806s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-20f128b9-95f1-4a57-8e12-398cc11959b3 req-d7d2f988-7bba-40cc-bac6-9034785e2629 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-20f128b9-95f1-4a57-8e12-398cc11959b3 req-d7d2f988-7bba-40cc-bac6-9034785e2629 tempest-TestServerVolumeAttachmentScenario-386288994 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-e02b76a6-1cce-48c1-940b-7591bab063e2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '498214da-7db5-406c-a651-5603d909da74', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:58:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "cinder-6f09e463-e0bf-4978-9019-ae58a959747c-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-20f128b9-95f1-4a57-8e12-398cc11959b3 req-d7d2f988-7bba-40cc-bac6-9034785e2629 tempest-TestServerVolumeAttachmentScenario-386288994 None] attachment_update completed successfully. Jul 10 06:58:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-6f09e463-e0bf-4978-9019-ae58a959747c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "cinder-quobyte-6f09e463-e0bf-4978-9019-ae58a959747c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-quobyte-6f09e463-e0bf-4978-9019-ae58a959747c" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c69a83c-03e3-43d8-9a14-a11899a9455f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:05 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c Jul 10 06:58:05 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:06 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c" returned: 0 in 0.792s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:06 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c Jul 10 06:58:06 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:06 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6f09e463-e0bf-4978-9019-ae58a959747c" returned: 0 in 0.677s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-quobyte-6f09e463-e0bf-4978-9019-ae58a959747c" released by "delete_volume" :: held 1.519s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:06 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Created reservations ['c204b51d-ec01-463b-b045-a26346fe96bb', '4f2020c2-1119-47cc-b067-04e5a94e27a1', 'e08451e4-813e-444a-945a-8ff35a317291', '5730685d-0435-4077-9e0c-58e8d9499367'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:06 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:06 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "cinder-3193ea72-125c-4c48-ae78-7f1ada8ef917-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-3193ea72-125c-4c48-ae78-7f1ada8ef917-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "cinder-quobyte-3193ea72-125c-4c48-ae78-7f1ada8ef917" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-quobyte-3193ea72-125c-4c48-ae78-7f1ada8ef917" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[865a540f-455f-43b4-aac7-4a701c6afc95]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:07 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.670s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:07 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Deleted volume successfully. Jul 10 06:58:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9265426b-6c95-4a42-8eb2-f1e90048b199 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-6f09e463-e0bf-4978-9019-ae58a959747c-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:07 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917 Jul 10 06:58:07 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:08 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917" returned: 0 in 0.796s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:08 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917 Jul 10 06:58:08 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:09 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-3193ea72-125c-4c48-ae78-7f1ada8ef917" returned: 0 in 0.674s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-quobyte-3193ea72-125c-4c48-ae78-7f1ada8ef917" released by "delete_volume" :: held 1.519s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Created reservations ['e161f362-152c-4d4b-a742-68ba3fd007ea', 'd05ec1cd-4934-4e86-9b37-7daf940807c1', '46897920-3684-4df8-b220-d7a81ab83e55', '8db5f841-88d5-47e1-a974-d3e08c72e850'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:09 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:09 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "cinder-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "cinder-quobyte-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-quobyte-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0ec112-1292-4d19-8eee-0d97b321b823]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:09 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.682s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Deleted volume successfully. Jul 10 06:58:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4cbd4790-35ca-4be8-9d5d-d0756f1d1485 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-3193ea72-125c-4c48-ae78-7f1ada8ef917-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:09 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6 Jul 10 06:58:09 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:10 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6" returned: 0 in 0.830s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:10 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6 Jul 10 06:58:10 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-316828a9-d52b-44e4-ab57-f5eb50f95a42 req-03afbbb9-e090-4123-a942-4f6d1c0e4280 tempest-TestServerVolumeAttachmentScenario-386288994 None] Terminate volume connection completed successfully. Jul 10 06:58:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-316828a9-d52b-44e4-ab57-f5eb50f95a42 req-03afbbb9-e090-4123-a942-4f6d1c0e4280 tempest-TestServerVolumeAttachmentScenario-386288994 None] Deleting attachment 498214da-7db5-406c-a651-5603d909da74. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:58:11 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6" returned: 0 in 0.698s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-quobyte-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6" released by "delete_volume" :: held 1.568s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Created reservations ['cb0d6374-6aa9-4cfc-b5e8-c49f413e751a', '46fb2388-75b8-4929-8adc-94eda69d3730', 'e0c79de3-4263-404b-aac1-853dd11811d8', 'aa65131a-9976-48da-8100-23cdff074e70'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:11 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:11 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:11 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:11 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "cinder-0053ad75-689e-41ee-a03e-3cee1a09d1a4-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-0053ad75-689e-41ee-a03e-3cee1a09d1a4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "cinder-quobyte-0053ad75-689e-41ee-a03e-3cee1a09d1a4" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-quobyte-0053ad75-689e-41ee-a03e-3cee1a09d1a4" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f6357b-a0d8-47f9-ad4b-653a9f090a50]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:12 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4 Jul 10 06:58:12 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:12 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.763s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:12 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Deleted volume successfully. Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f126770f-0eec-4543-897e-6947df92ff53 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-01b4ff8a-a5e8-4f09-b1c9-1911b9f6eea6-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:12 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.761s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:58:12 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4" returned: 0 in 0.831s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:12 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4 Jul 10 06:58:12 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:13 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0053ad75-689e-41ee-a03e-3cee1a09d1a4" returned: 0 in 0.676s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-quobyte-0053ad75-689e-41ee-a03e-3cee1a09d1a4" released by "delete_volume" :: held 1.567s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:13 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Created reservations ['e2430578-79cc-47c6-9288-5988e90c4bc9', '01ffc63f-7c79-4c17-bd1b-f409ad8dfe60', 'a45ba45a-2254-45f0-85e8-cc5b11d4f181', '1161fe52-ffe3-48eb-9db5-55a6e590c06e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:13 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:13 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "cinder-a2ebb57d-2ce8-43e2-a614-b4d100829f46-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-a2ebb57d-2ce8-43e2-a614-b4d100829f46-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "cinder-quobyte-a2ebb57d-2ce8-43e2-a614-b4d100829f46" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-quobyte-a2ebb57d-2ce8-43e2-a614-b4d100829f46" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6a927b-13e4-49fe-ab22-ac2c491d6a21]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:14 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.723s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:14 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Deleted volume successfully. Jul 10 06:58:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0f04e58-078f-4999-8775-285d64143944 tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-0053ad75-689e-41ee-a03e-3cee1a09d1a4-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:14 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46 Jul 10 06:58:14 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-b2e8e3f9-a4be-4498-a206-653f35fc3f35 req-5e91759e-0af5-400e-b91d-e86ab12b0748 tempest-TestServerVolumeAttachmentScenario-386288994 None] Terminate volume connection completed successfully. Jul 10 06:58:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-b2e8e3f9-a4be-4498-a206-653f35fc3f35 req-5e91759e-0af5-400e-b91d-e86ab12b0748 tempest-TestServerVolumeAttachmentScenario-386288994 None] Deleting attachment 218bb0a4-b2aa-4254-8a3d-5b6834cfaaec. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:58:15 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46" returned: 0 in 0.872s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:15 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46 Jul 10 06:58:15 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:15 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a2ebb57d-2ce8-43e2-a614-b4d100829f46" returned: 0 in 0.682s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-quobyte-a2ebb57d-2ce8-43e2-a614-b4d100829f46" released by "delete_volume" :: held 1.594s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:15 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Created reservations ['f98bada3-0208-41c7-a789-6dd37ac1bec1', '6cf6e82f-28e6-408e-8e84-53eebe08d282', '545d3a13-bfdf-412f-9a14-20f574790d29', 'b3a36567-c476-4e7b-a6d3-50f3747f67af'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:16 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:16 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:16 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.712s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:16 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Deleted volume successfully. Jul 10 06:58:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f87365d9-5a25-4d9a-9827-5a3b0cf7d04d tempest-CreateVolumesFromImageTest-1000302987 None] Lock "cinder-a2ebb57d-2ce8-43e2-a614-b4d100829f46-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (64b86717-bbec-4a35-adf2-9e8780a73643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2f2dc0-be61-4ab0-94b2-ba89e4c6af35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2f2dc0-be61-4ab0-94b2-ba89e4c6af35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692797626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01639da5-1251-4d70-adfb-3480a67dbb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:20Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74df9ae1-b5e6-4377-bb07-c30739e281ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74df9ae1-b5e6-4377-bb07-c30739e281ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4c8f9b-efd8-4613-b4cb-305e1e292529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4c8f9b-efd8-4613-b4cb-305e1e292529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01639da5-1251-4d70-adfb-3480a67dbb38', 'volume_name': 'volume-01639da5-1251-4d70-adfb-3480a67dbb38', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0527673e-d3cc-405b-92e1-3c68f689f344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0527673e-d3cc-405b-92e1-3c68f689f344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26df67b3-c49e-4b98-86b9-88923ca537f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:19 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume 01639da5-1251-4d70-adfb-3480a67dbb38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01639da5-1251-4d70-adfb-3480a67dbb38', 'volume_size': 1} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692797626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01639da5-1251-4d70-adfb-3480a67dbb38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:20Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Creating volume 01639da5-1251-4d70-adfb-3480a67dbb38 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:19 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:58:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:19 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 1073741824 Jul 10 06:58:19 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:20 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 1073741824" returned: 0 in 0.859s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:20 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 Jul 10 06:58:20 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:21 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38" returned: 0 in 0.668s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:21 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26df67b3-c49e-4b98-86b9-88923ca537f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01639da5-1251-4d70-adfb-3480a67dbb38', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b067525-7aab-4737-836e-31c5c2b888fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:21 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume volume-01639da5-1251-4d70-adfb-3480a67dbb38 (01639da5-1251-4d70-adfb-3480a67dbb38): created successfully Jul 10 06:58:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b067525-7aab-4737-836e-31c5c2b888fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (64b86717-bbec-4a35-adf2-9e8780a73643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bd34430b-48ad-442f-aa22-58c2e6d33c22 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created volume successfully. Jul 10 06:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Creating offline snapshot 3c7664eb-53c8-4f42-89d1-b62001ec925a of volume 01639da5-1251-4d70-adfb-3480a67dbb38 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:58:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[16363b07-b4d2-4a81-a613-ed361279b43c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:22 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 Jul 10 06:58:22 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:22 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38" returned: 0 in 0.800s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:22 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a 1G Jul 10 06:58:22 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:23 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a 1G" returned: 0 in 0.849s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01639da5-1251-4d70-adfb-3480a67dbb38 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:23 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01639da5-1251-4d70-adfb-3480a67dbb38 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a Jul 10 06:58:23 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:24 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01639da5-1251-4d70-adfb-3480a67dbb38 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a" returned: 0 in 0.691s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:24 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a is being set with open permissions: ugo+rw Jul 10 06:58:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:24 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a Jul 10 06:58:24 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:25 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a" returned: 0 in 0.662s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "cinder-e02b76a6-1cce-48c1-940b-7591bab063e2-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "cinder-e02b76a6-1cce-48c1-940b-7591bab063e2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:25 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.info Jul 10 06:58:25 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "cinder-quobyte-e02b76a6-1cce-48c1-940b-7591bab063e2" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "cinder-quobyte-e02b76a6-1cce-48c1-940b-7591bab063e2" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:25 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be23f16-2108-4fd3-86b4-5cff7beec7c6]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:25 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2 Jul 10 06:58:25 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:25 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.info" returned: 0 in 0.664s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:25 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.info is being set with open permissions: ugo+rw Jul 10 06:58:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:25 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.info Jul 10 06:58:25 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:26 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:26 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2 Jul 10 06:58:26 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:26 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.info" returned: 0 in 0.695s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.463s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3672b07d-590d-4ba8-9d2b-34feb266dcc7 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Create snapshot completed successfully Jul 10 06:58:26 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e02b76a6-1cce-48c1-940b-7591bab063e2" returned: 0 in 0.647s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "cinder-quobyte-e02b76a6-1cce-48c1-940b-7591bab063e2" released by "delete_volume" :: held 1.479s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Created reservations ['fe964953-9d99-4d27-bf7d-5775bb7ee9f1', '935af7a7-3f58-4905-8a1c-457486b7a2c8', 'a84005e6-b9da-4627-b873-6f4c7be0e197', '6222e3bc-dad3-4158-9366-0d643ff4ac7c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:26 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:26 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "cinder-0d8c9fa6-a652-4b99-aa2d-428f9945f980-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "cinder-0d8c9fa6-a652-4b99-aa2d-428f9945f980-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:27 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "cinder-quobyte-0d8c9fa6-a652-4b99-aa2d-428f9945f980" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.653s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Deleted volume successfully. Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "cinder-quobyte-0d8c9fa6-a652-4b99-aa2d-428f9945f980" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08cf2b5d-7a77-40ac-bfa2-5aaf843740d2 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "cinder-e02b76a6-1cce-48c1-940b-7591bab063e2-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e72bfc-2006-4966-988c-b21ec6efa069]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:27 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 Jul 10 06:58:27 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (67aff630-74e2-4ce5-928c-3d456b557329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1b4748-b84c-4576-8056-c744743d2b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1b4748-b84c-4576-8056-c744743d2b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1179624163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a4d8f1-0394-4da7-a4bb-710df392df60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:28Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5f0c95-64c8-42d3-be36-536d52b5446d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5f0c95-64c8-42d3-be36-536d52b5446d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84104e00-60c1-41f6-aa6f-479091741ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84104e00-60c1-41f6-aa6f-479091741ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a4d8f1-0394-4da7-a4bb-710df392df60', 'volume_name': 'volume-71a4d8f1-0394-4da7-a4bb-710df392df60', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a271fd-20b6-411c-9e69-45348adc0f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a271fd-20b6-411c-9e69-45348adc0f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b5eacc-2fae-4ff5-b898-984507f1ea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:27 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume 71a4d8f1-0394-4da7-a4bb-710df392df60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a4d8f1-0394-4da7-a4bb-710df392df60', 'volume_size': 1} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1179624163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a4d8f1-0394-4da7-a4bb-710df392df60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:28Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Creating volume 71a4d8f1-0394-4da7-a4bb-710df392df60 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:27 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:58:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:27 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60 1073741824 Jul 10 06:58:27 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (91ce87de-8436-40f2-8f6d-e79f99ff0f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8039a58c-71e3-41b9-b8ce-ca0f18288b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8039a58c-71e3-41b9-b8ce-ca0f18288b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13180088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd2906a-7a08-44fd-9a61-d0a96560ac78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:28Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ffbec3-bb20-427c-9095-fa85181bd65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ffbec3-bb20-427c-9095-fa85181bd65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0d86bb-71a9-4384-aac0-82778b74fa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0d86bb-71a9-4384-aac0-82778b74fa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd2906a-7a08-44fd-9a61-d0a96560ac78', 'volume_name': 'volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12627d69-c11d-4d1c-9ec1-c9d149a67ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12627d69-c11d-4d1c-9ec1-c9d149a67ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3447fdd4-c2c0-4df4-997f-0a4b57211439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume 1fd2906a-7a08-44fd-9a61-d0a96560ac78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78', 'volume_size': 1} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:28 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980" returned: 0 in 0.939s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:28 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980 Jul 10 06:58:28 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (4cc650c7-cb51-4fb4-a740-935a131bf428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be98f6b9-941f-4334-aec2-08b4187a61d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be98f6b9-941f-4334-aec2-08b4187a61d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-658438668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77de65b4-70e3-4687-a1b7-361a86d1d165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:29Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9067e944-5fc2-4a9e-9d59-ed8c37483621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9067e944-5fc2-4a9e-9d59-ed8c37483621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b8dc83-7d86-4ea3-a5fc-6fdb602bdd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b8dc83-7d86-4ea3-a5fc-6fdb602bdd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77de65b4-70e3-4687-a1b7-361a86d1d165', 'volume_name': 'volume-77de65b4-70e3-4687-a1b7-361a86d1d165', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b5cdbd-794f-4fae-a1b8-4db86b949a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b5cdbd-794f-4fae-a1b8-4db86b949a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6db3a1c-7676-4f56-9911-f5a3a0313792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume 77de65b4-70e3-4687-a1b7-361a86d1d165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77de65b4-70e3-4687-a1b7-361a86d1d165', 'volume_size': 1} Jul 10 06:58:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:29 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60 1073741824" returned: 0 in 1.147s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (d0b16478-0cea-4c5b-a158-15f2b7ff7f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854fb1b2-b354-43d2-8d32-64e97d9bcb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854fb1b2-b354-43d2-8d32-64e97d9bcb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-48123434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d731926b-1a90-4088-9e02-c74e40602dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:29Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4199d425-7123-4269-bbb8-63b2190672b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4199d425-7123-4269-bbb8-63b2190672b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc0a0b2-4c67-4e24-b182-46eb4cb37fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc0a0b2-4c67-4e24-b182-46eb4cb37fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd731926b-1a90-4088-9e02-c74e40602dc3', 'volume_name': 'volume-d731926b-1a90-4088-9e02-c74e40602dc3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26db8d12-e756-4a60-b461-ebc66d0905d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26db8d12-e756-4a60-b461-ebc66d0905d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ee7d23-9e46-4f11-8457-77b943dfb109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume d731926b-1a90-4088-9e02-c74e40602dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d731926b-1a90-4088-9e02-c74e40602dc3', 'volume_size': 1} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:29 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60 Jul 10 06:58:29 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:29 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0d8c9fa6-a652-4b99-aa2d-428f9945f980" returned: 0 in 0.861s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "cinder-quobyte-0d8c9fa6-a652-4b99-aa2d-428f9945f980" released by "delete_volume" :: held 1.859s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Created reservations ['e4ae7400-c2be-44ca-ae1e-836161b05fce', '77702b1a-1421-462a-91c1-02a144058840', '0fae80d0-31ac-4ac8-9748-6774de0a973b', 'e759c373-9f7d-46af-a435-3c1cdaf23482'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (66fce97b-6b44-450f-b6df-b5555e1bf02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16309c6b-04b2-478e-89e0-b28d8ec82b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16309c6b-04b2-478e-89e0-b28d8ec82b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012619303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa652349-d569-4fd0-9dfe-d9ff7d473117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:29Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:29 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:29 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832f8b6a-8101-4248-bbf6-3ad09d52737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832f8b6a-8101-4248-bbf6-3ad09d52737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e884b6af-acc6-4b6d-b8a0-001116dae6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e884b6af-acc6-4b6d-b8a0-001116dae6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa652349-d569-4fd0-9dfe-d9ff7d473117', 'volume_name': 'volume-aa652349-d569-4fd0-9dfe-d9ff7d473117', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1734f81b-bbab-4cff-b3f1-e6e2cf5912f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1734f81b-bbab-4cff-b3f1-e6e2cf5912f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718a3b6e-7b07-4d1d-82ea-f66fb7ce457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume aa652349-d569-4fd0-9dfe-d9ff7d473117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa652349-d569-4fd0-9dfe-d9ff7d473117', 'volume_size': 1} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:29 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.634s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-13180088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd2906a-7a08-44fd-9a61-d0a96560ac78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:28Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Creating volume 1fd2906a-7a08-44fd-9a61-d0a96560ac78 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:29 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:58:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:30 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78 1073741824 Jul 10 06:58:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b5eacc-2fae-4ff5-b898-984507f1ea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a4d8f1-0394-4da7-a4bb-710df392df60', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:30 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ad2efe-72cd-46f5-9b3f-e34b1e348533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:30 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume volume-71a4d8f1-0394-4da7-a4bb-710df392df60 (71a4d8f1-0394-4da7-a4bb-710df392df60): created successfully Jul 10 06:58:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ad2efe-72cd-46f5-9b3f-e34b1e348533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (67aff630-74e2-4ce5-928c-3d456b557329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2d333179-5706-412d-87a0-a05913ceb444 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created volume successfully. Jul 10 06:58:30 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.773s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:30 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Deleted volume successfully. Jul 10 06:58:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-39acde9c-5b59-40a5-a35e-6022cec1b4e1 tempest-TestServerVolumeAttachmentScenario-386288994 None] Lock "cinder-0d8c9fa6-a652-4b99-aa2d-428f9945f980-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:30 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78 1073741824" returned: 0 in 0.900s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:30 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78 Jul 10 06:58:30 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:31 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78" returned: 0 in 0.671s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.836s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-658438668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77de65b4-70e3-4687-a1b7-361a86d1d165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:29Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Creating volume 77de65b4-70e3-4687-a1b7-361a86d1d165 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:31 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3447fdd4-c2c0-4df4-997f-0a4b57211439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:31 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165 1073741824 Jul 10 06:58:31 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc87dc02-3cc2-4736-90af-9a0b80fdc9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:31 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78 (1fd2906a-7a08-44fd-9a61-d0a96560ac78): created successfully Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc87dc02-3cc2-4736-90af-9a0b80fdc9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (91ce87de-8436-40f2-8f6d-e79f99ff0f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-381e7da1-e4f5-4aa1-a676-6b21b3e29424 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created volume successfully. Jul 10 06:58:32 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165 1073741824" returned: 0 in 0.925s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:32 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165 Jul 10 06:58:32 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:33 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165" returned: 0 in 0.806s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.215s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-48123434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d731926b-1a90-4088-9e02-c74e40602dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:29Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Creating volume d731926b-1a90-4088-9e02-c74e40602dc3 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:33 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6db3a1c-7676-4f56-9911-f5a3a0313792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77de65b4-70e3-4687-a1b7-361a86d1d165', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3976e8c-6c33-4c67-a8e4-fbfae605d0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:33 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3 1073741824 Jul 10 06:58:33 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume volume-77de65b4-70e3-4687-a1b7-361a86d1d165 (77de65b4-70e3-4687-a1b7-361a86d1d165): created successfully Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3976e8c-6c33-4c67-a8e4-fbfae605d0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (4cc650c7-cb51-4fb4-a740-935a131bf428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c37d2712-1d56-4513-a551-494a659b8baf tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created volume successfully. Jul 10 06:58:34 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3 1073741824" returned: 0 in 1.009s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:34 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3 Jul 10 06:58:34 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:35 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3" returned: 0 in 0.683s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.418s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012619303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa652349-d569-4fd0-9dfe-d9ff7d473117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89cad62abe7c42de998e6bd04969dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:29Z,use_quota=True,user_id='b0264c42434645eb92c5b01570986bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Creating volume aa652349-d569-4fd0-9dfe-d9ff7d473117 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:35 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:35 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117 1073741824 Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ee7d23-9e46-4f11-8457-77b943dfb109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d731926b-1a90-4088-9e02-c74e40602dc3', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:35 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae198db1-95ae-4ff0-a7d8-050958b67a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume volume-d731926b-1a90-4088-9e02-c74e40602dc3 (d731926b-1a90-4088-9e02-c74e40602dc3): created successfully Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae198db1-95ae-4ff0-a7d8-050958b67a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (d0b16478-0cea-4c5b-a158-15f2b7ff7f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-22886f76-b2b2-479a-bf1e-c8e465ca25d8 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created volume successfully. Jul 10 06:58:36 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117 1073741824" returned: 0 in 0.889s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:36 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117 Jul 10 06:58:36 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:36 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117" returned: 0 in 0.783s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718a3b6e-7b07-4d1d-82ea-f66fb7ce457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa652349-d569-4fd0-9dfe-d9ff7d473117', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f209028-7ba5-45b9-b580-86065831aba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:36 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Volume volume-aa652349-d569-4fd0-9dfe-d9ff7d473117 (aa652349-d569-4fd0-9dfe-d9ff7d473117): created successfully Jul 10 06:58:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f209028-7ba5-45b9-b580-86065831aba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:36 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Flow 'volume_create_manager' (66fce97b-6b44-450f-b6df-b5555e1bf02e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-57b28f7d-5ff9-4072-a60b-e6db5f3d860d tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created volume successfully. Jul 10 06:58:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-aa652349-d569-4fd0-9dfe-d9ff7d473117-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-aa652349-d569-4fd0-9dfe-d9ff7d473117-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-quobyte-aa652349-d569-4fd0-9dfe-d9ff7d473117" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-aa652349-d569-4fd0-9dfe-d9ff7d473117" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:37 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53229bc-435d-4078-b316-dba1897bf6ba]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:37 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117 Jul 10 06:58:37 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:38 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117" returned: 0 in 0.889s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:38 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117 Jul 10 06:58:38 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:39 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-aa652349-d569-4fd0-9dfe-d9ff7d473117" returned: 0 in 0.811s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-aa652349-d569-4fd0-9dfe-d9ff7d473117" released by "delete_volume" :: held 1.765s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created reservations ['fb57c79a-90cc-44aa-9e6e-297499163b35', '72538ebc-c4bf-4ff3-a3c1-c9169afac638', '3f5ee6dc-63d5-4ff2-b997-1d3185165f03', '3c416453-f820-4ca4-9de1-5e6bb2463fbf'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:39 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:39 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-d731926b-1a90-4088-9e02-c74e40602dc3-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-d731926b-1a90-4088-9e02-c74e40602dc3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-quobyte-d731926b-1a90-4088-9e02-c74e40602dc3" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-d731926b-1a90-4088-9e02-c74e40602dc3" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a86d16-fd58-4e9d-9951-ed7838eaa615]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:39 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3 Jul 10 06:58:39 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:40 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.706s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:40 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Deleted volume successfully. Jul 10 06:58:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2491d0a3-366a-4a6f-8f1e-67752fac33fe tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-aa652349-d569-4fd0-9dfe-d9ff7d473117-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:40 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3" returned: 0 in 0.826s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:40 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3 Jul 10 06:58:40 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:41 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d731926b-1a90-4088-9e02-c74e40602dc3" returned: 0 in 0.683s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-d731926b-1a90-4088-9e02-c74e40602dc3" released by "delete_volume" :: held 1.559s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created reservations ['a3e15494-aa6d-4b33-a6b0-d1cf4918282b', '9aa4b9ea-1d5a-4f8f-80ec-dc1dd06698f5', '727d47ba-19d9-4874-a2d8-cf47c7f29793', 'da68b398-4540-46f6-a260-1438f4c6b891'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:41 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:41 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-77de65b4-70e3-4687-a1b7-361a86d1d165-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-77de65b4-70e3-4687-a1b7-361a86d1d165-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-quobyte-77de65b4-70e3-4687-a1b7-361a86d1d165" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-77de65b4-70e3-4687-a1b7-361a86d1d165" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff85f109-1d62-4b4d-81a7-759f8c711725]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:42 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.713s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:42 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Deleted volume successfully. Jul 10 06:58:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c59fd3e9-b1be-436e-8c0f-b723dc2ce8ef tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-d731926b-1a90-4088-9e02-c74e40602dc3-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:42 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165 Jul 10 06:58:42 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:42 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165" returned: 0 in 0.794s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:42 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165 Jul 10 06:58:42 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:43 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-77de65b4-70e3-4687-a1b7-361a86d1d165" returned: 0 in 0.689s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-77de65b4-70e3-4687-a1b7-361a86d1d165" released by "delete_volume" :: held 1.527s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:43 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created reservations ['72e91e16-730f-4b33-bd11-27e77ec382ca', '9c903065-ada5-4164-8d5f-79367602a5f6', 'b4921370-91fb-4ac8-bf06-6a2b760419f4', 'e0460a05-9509-4191-8b5e-c9c49ff1b988'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:43 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:43 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-1fd2906a-7a08-44fd-9a61-d0a96560ac78-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-1fd2906a-7a08-44fd-9a61-d0a96560ac78-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-quobyte-1fd2906a-7a08-44fd-9a61-d0a96560ac78" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-1fd2906a-7a08-44fd-9a61-d0a96560ac78" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc016800-db66-475f-bfef-9f8ab71d0cde]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:44 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:44 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Deleted volume successfully. Jul 10 06:58:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-16acf32b-fe8a-4c7b-a039-2d2bbfd4d2dd tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-77de65b4-70e3-4687-a1b7-361a86d1d165-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:44 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78 Jul 10 06:58:44 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:45 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78" returned: 0 in 0.815s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:45 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78 Jul 10 06:58:45 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:45 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1fd2906a-7a08-44fd-9a61-d0a96560ac78" returned: 0 in 0.785s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-1fd2906a-7a08-44fd-9a61-d0a96560ac78" released by "delete_volume" :: held 1.651s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:45 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=98,cinder:UPDATE=125,cinder:INSERT=22,cinder:DELETE=9 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:58:45 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created reservations ['c4d281bf-68b9-4c54-883b-9cf8efd4e901', '06195ec1-4627-4135-a86d-d3ad0e1dd8a2', 'c1b040db-938c-4c7e-8e19-b37e3760d20d', 'ac20be8a-4bb6-4a99-8f6c-90ed5f704b5f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:46 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:46 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-71a4d8f1-0394-4da7-a4bb-710df392df60-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-71a4d8f1-0394-4da7-a4bb-710df392df60-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=119,cinder:SELECT=89,cinder:INSERT=31,cinder:DELETE=13 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-quobyte-71a4d8f1-0394-4da7-a4bb-710df392df60" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-71a4d8f1-0394-4da7-a4bb-710df392df60" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac9e9fb-6f0b-4182-932e-c63e182037bd]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:46 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60 Jul 10 06:58:46 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:46 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.747s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Deleted volume successfully. Jul 10 06:58:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d6299a23-894b-4f10-ada2-1f63ddb0c513 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-1fd2906a-7a08-44fd-9a61-d0a96560ac78-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:47 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60" returned: 0 in 0.862s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:47 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60 Jul 10 06:58:47 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:48 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-71a4d8f1-0394-4da7-a4bb-710df392df60" returned: 0 in 0.801s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-71a4d8f1-0394-4da7-a4bb-710df392df60" released by "delete_volume" :: held 1.710s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created reservations ['69abcd52-7be0-4e57-89e7-1c3647e82357', '6be4cf7f-9047-495c-b674-898fa2d998e6', 'df59c1f2-65db-41f2-a2ee-6864c6dc39df', 'aa5e24e2-479c-4323-8284-38406e560620'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:48 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:48 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-3c7664eb-53c8-4f42-89d1-b62001ec925a-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-3c7664eb-53c8-4f42-89d1-b62001ec925a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-quobyte-01639da5-1251-4d70-adfb-3480a67dbb38" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-01639da5-1251-4d70-adfb-3480a67dbb38" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-quobyte-3c7664eb-53c8-4f42-89d1-b62001ec925a" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-3c7664eb-53c8-4f42-89d1-b62001ec925a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Deleting offline snapshot 3c7664eb-53c8-4f42-89d1-b62001ec925a of volume 01639da5-1251-4d70-adfb-3480a67dbb38 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] snapshot_file for this snap is: volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[be69cad9-7ac8-4ffc-bf6c-af67a2e9b6e7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:49 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a Jul 10 06:58:49 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:49 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.728s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:49 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Deleted volume successfully. Jul 10 06:58:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d2b93890-ba60-4298-aa13-92c9981fda35 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-71a4d8f1-0394-4da7-a4bb-710df392df60-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:49 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a" returned: 0 in 0.901s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01639da5-1251-4d70-adfb-3480a67dbb38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:58:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b74a4cf-68e5-4965-b6f2-1cda2140810a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:49 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 Jul 10 06:58:49 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:50 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38" returned: 0 in 0.935s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:50 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a Jul 10 06:58:50 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:51 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a" returned: 0 in 0.825s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:51 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a Jul 10 06:58:51 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:52 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38.3c7664eb-53c8-4f42-89d1-b62001ec925a" returned: 0 in 0.713s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-3c7664eb-53c8-4f42-89d1-b62001ec925a" released by "_delete_snapshot" :: held 3.503s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-01639da5-1251-4d70-adfb-3480a67dbb38" released by "delete_snapshot" :: held 3.539s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:52 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created reservations ['62f47ad2-f4a9-4f8c-ab35-20e2bca83078', 'e5965709-1563-4a17-a291-0f55747c3f65', 'a3003a8e-94b4-45cb-9d35-c53777ca9b9f', '1aa5c962-8f51-4bdd-9f0a-299f4565085d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Delete snapshot completed successfully. Jul 10 06:58:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9eb1a7d1-cfef-4048-8952-736582062e4a tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-3c7664eb-53c8-4f42-89d1-b62001ec925a-delete_snapshot" released by "delete_snapshot" :: held 3.803s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-01639da5-1251-4d70-adfb-3480a67dbb38-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-01639da5-1251-4d70-adfb-3480a67dbb38-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "cinder-quobyte-01639da5-1251-4d70-adfb-3480a67dbb38" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-01639da5-1251-4d70-adfb-3480a67dbb38" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d067e6b-1355-414e-b042-8a34d55ca31f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:53 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 Jul 10 06:58:53 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:54 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38" returned: 0 in 0.818s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:54 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38 Jul 10 06:58:54 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:54 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-01639da5-1251-4d70-adfb-3480a67dbb38" returned: 0 in 0.711s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-quobyte-01639da5-1251-4d70-adfb-3480a67dbb38" released by "delete_volume" :: held 1.589s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:54 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Created reservations ['5ce74956-d75d-4498-babc-9ee32b922338', '67d9a92c-7218-4d5f-9fb9-cd82009b1c9e', '4b72c904-dc40-4745-932d-e5c948c05c7a', 'e8ba4fb3-5ab2-480f-80ce-86fb5aa20179'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:54 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:58:54 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:55 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.689s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:55 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Deleted volume successfully. Jul 10 06:58:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b55cd794-ee2a-4860-8cef-af3273c31648 tempest-CreateVolumesFromSnapshotTest-1125921774 None] Lock "cinder-01639da5-1251-4d70-adfb-3480a67dbb38-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Flow 'volume_create_manager' (161a7d1f-aa4e-4ac5-9fe6-81379d7a3304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad8e3f-dcb3-443e-bc1b-07de557b70ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad8e3f-dcb3-443e-bc1b-07de557b70ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1357068745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613a23a4-a4ec-4666-beb5-1ef42740dcb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212466dc7d204580b9fe28af70effcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:59Z,use_quota=True,user_id='336b28cadc734f9584a7cf4cf89c7997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398bec10-5f07-4923-903e-fee122c270f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398bec10-5f07-4923-903e-fee122c270f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252bea71-a8af-4ac7-9ef7-154169d8c899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252bea71-a8af-4ac7-9ef7-154169d8c899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '613a23a4-a4ec-4666-beb5-1ef42740dcb0', 'volume_name': 'volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e22f66-ea90-46e7-ae08-a5e0f3cfeb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e22f66-ea90-46e7-ae08-a5e0f3cfeb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d057fab-3f86-4e7e-a964-c2be3720920d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:58 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Volume 613a23a4-a4ec-4666-beb5-1ef42740dcb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0', 'volume_size': 1} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1357068745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613a23a4-a4ec-4666-beb5-1ef42740dcb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212466dc7d204580b9fe28af70effcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:59Z,use_quota=True,user_id='336b28cadc734f9584a7cf4cf89c7997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Creating volume 613a23a4-a4ec-4666-beb5-1ef42740dcb0 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:58 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:58:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:58 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 1073741824 Jul 10 06:58:58 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:59 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 1073741824" returned: 0 in 0.924s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:59 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 Jul 10 06:58:59 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:00 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0" returned: 0 in 0.684s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:59:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d057fab-3f86-4e7e-a964-c2be3720920d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c433deab-bdb4-4eaa-9630-1a9fe16b5608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:00 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Volume volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 (613a23a4-a4ec-4666-beb5-1ef42740dcb0): created successfully Jul 10 06:59:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c433deab-bdb4-4eaa-9630-1a9fe16b5608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Flow 'volume_create_manager' (161a7d1f-aa4e-4ac5-9fe6-81379d7a3304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4f13ca29-fd9e-416d-abb8-71855a5f2595 tempest-VolumeDependencyTests-1936612245 None] Created volume successfully. Jul 10 06:59:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] Creating offline snapshot 8e4a3daf-5245-41fe-bff8-ad992bb3800d of volume 613a23a4-a4ec-4666-beb5-1ef42740dcb0 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:59:01 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bc7f41-a962-4ca3-b532-297ad939a3c7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:01 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 Jul 10 06:59:01 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:01 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0" returned: 0 in 0.802s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:01 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d 1G Jul 10 06:59:01 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:02 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d 1G" returned: 0 in 0.886s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:02 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d Jul 10 06:59:02 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:03 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d" returned: 0 in 0.756s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:03 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d is being set with open permissions: ugo+rw Jul 10 06:59:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:03 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d Jul 10 06:59:03 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Flow 'volume_create_manager' (1ec4b52b-a9eb-4a62-b1b7-dd5ed4f1dfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7aa43b5-d80e-48fe-9f20-7f1e4667e2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7aa43b5-d80e-48fe-9f20-7f1e4667e2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-596382204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d229056-cd8f-4f46-9d78-89838b2d7a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7861d2797de5494298b9f3263016ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:04Z,use_quota=True,user_id='938d6cdd6d084db7acadf03c4c54fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca09480-093c-4f25-8a3d-d89830aaf1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca09480-093c-4f25-8a3d-d89830aaf1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90c9a33-66e6-404f-aee8-f9a63d993007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90c9a33-66e6-404f-aee8-f9a63d993007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d229056-cd8f-4f46-9d78-89838b2d7a96', 'volume_name': 'volume-5d229056-cd8f-4f46-9d78-89838b2d7a96', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11f8c6d-4c42-4cd2-83ff-9be43e5dcac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11f8c6d-4c42-4cd2-83ff-9be43e5dcac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14328c4-f06f-474a-b053-3908330a133f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Volume 5d229056-cd8f-4f46-9d78-89838b2d7a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d229056-cd8f-4f46-9d78-89838b2d7a96', 'volume_size': 1} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:04 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d" returned: 0 in 0.792s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:04 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.info Jul 10 06:59:04 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:05 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.info" returned: 0 in 0.735s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:05 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.info is being set with open permissions: ugo+rw Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:05 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.info Jul 10 06:59:05 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:05 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.info" returned: 0 in 0.698s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-596382204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d229056-cd8f-4f46-9d78-89838b2d7a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7861d2797de5494298b9f3263016ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:04Z,use_quota=True,user_id='938d6cdd6d084db7acadf03c4c54fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Creating volume 5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:59:05 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:59:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:05 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 1073741824 Jul 10 06:59:05 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-781e1417-b527-4f1c-9e2b-d6ef29454b38 tempest-VolumeDependencyTests-1936612245 None] Create snapshot completed successfully Jul 10 06:59:06 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 1073741824" returned: 0 in 0.872s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:06 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 Jul 10 06:59:06 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Flow 'volume_create_manager' (4f167ec1-cb6d-49c1-967a-8127a595c280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16481360-4bc7-4b07-be69-df782181998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16481360-4bc7-4b07-be69-df782181998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-474784556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0dd934-8a85-44d6-b9a6-34ea8f62edeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212466dc7d204580b9fe28af70effcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e4a3daf-5245-41fe-bff8-ad992bb3800d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:07Z,use_quota=True,user_id='336b28cadc734f9584a7cf4cf89c7997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc1d0fd-cfe0-44b8-9413-d4b622bdc956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc1d0fd-cfe0-44b8-9413-d4b622bdc956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873337ff-2668-4089-8500-916bb4876f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873337ff-2668-4089-8500-916bb4876f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e0dd934-8a85-44d6-b9a6-34ea8f62edeb', 'volume_name': 'volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb', 'volume_size': 1, 'snapshot_id': '8e4a3daf-5245-41fe-bff8-ad992bb3800d'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6390f3-147c-44a0-b7a9-c8d68bb5f48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6390f3-147c-44a0-b7a9-c8d68bb5f48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fde27d5-d07b-4c20-9617-3f050e91b9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Volume 6e0dd934-8a85-44d6-b9a6-34ea8f62edeb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb', 'volume_size': 1, 'snapshot_id': '8e4a3daf-5245-41fe-bff8-ad992bb3800d'} Jul 10 06:59:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:07 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96" returned: 0 in 0.682s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.475s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "cinder-quobyte-8e4a3daf-5245-41fe-bff8-ad992bb3800d-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14328c4-f06f-474a-b053-3908330a133f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d229056-cd8f-4f46-9d78-89838b2d7a96', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce48c2a8-eb55-4b4c-a385-4b2a8abcb1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-8e4a3daf-5245-41fe-bff8-ad992bb3800d-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Creating volume 6e0dd934-8a85-44d6-b9a6-34ea8f62edeb from snapshot 8e4a3daf-5245-41fe-bff8-ad992bb3800d {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "cinder-quobyte-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Volume volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 (5d229056-cd8f-4f46-9d78-89838b2d7a96): created successfully Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce48c2a8-eb55-4b4c-a385-4b2a8abcb1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Flow 'volume_create_manager' (1ec4b52b-a9eb-4a62-b1b7-dd5ed4f1dfa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] snapshot: 8e4a3daf-5245-41fe-bff8-ad992bb3800d, volume: 6e0dd934-8a85-44d6-b9a6-34ea8f62edeb, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:59:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d8de571b-dd58-4e7f-ab10-0c0abc0b6945 tempest-TestStampPattern-926077374 None] Created volume successfully. Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ef3497-431e-45df-bef3-b17b03045f61]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:07 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d Jul 10 06:59:07 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:08 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d" returned: 0 in 0.756s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:59:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:59:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:59:08 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc17c08-e2d5-4ec6-a225-9396b4e1d5eb]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:08 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 Jul 10 06:59:08 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:09 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0" returned: 0 in 0.793s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:09 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:59:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:09 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb Jul 10 06:59:09 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:11 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:59:11 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:13 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.590s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:13 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:13 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:59:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:59:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:59:15 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" returned: 0 in 5.988s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f354bad1-ddd8-41b8-abcd-f7a65da44729]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:15 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 Jul 10 06:59:15 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:16 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0" returned: 0 in 0.992s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:16 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:59:16 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Converted 1024.00 MB image at 170.95 MB/s Jul 10 06:59:16 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb is being set with open permissions: ugo+rw Jul 10 06:59:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:16 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb Jul 10 06:59:16 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:16 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" returned: 0 in 0.669s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" released by "_copy_volume_from_snapshot" :: held 9.300s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-8e4a3daf-5245-41fe-bff8-ad992bb3800d-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" released by "_create_volume_from_snapshot" :: held 9.342s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.373s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fde27d5-d07b-4c20-9617-3f050e91b9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb', 'volume_size': 1, 'snapshot_id': '8e4a3daf-5245-41fe-bff8-ad992bb3800d'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b739748a-ca7c-4b4e-907c-76ecc16df598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Volume volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb (6e0dd934-8a85-44d6-b9a6-34ea8f62edeb): created successfully Jul 10 06:59:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b739748a-ca7c-4b4e-907c-76ecc16df598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Flow 'volume_create_manager' (4f167ec1-cb6d-49c1-967a-8127a595c280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:16 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3ccdcc46-2d1d-415e-8743-85384d42e4cb tempest-VolumeDependencyTests-1936612245 None] Created volume successfully. Jul 10 06:59:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "cinder-8e4a3daf-5245-41fe-bff8-ad992bb3800d-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-8e4a3daf-5245-41fe-bff8-ad992bb3800d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "cinder-quobyte-613a23a4-a4ec-4666-beb5-1ef42740dcb0" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-613a23a4-a4ec-4666-beb5-1ef42740dcb0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "cinder-quobyte-8e4a3daf-5245-41fe-bff8-ad992bb3800d" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-8e4a3daf-5245-41fe-bff8-ad992bb3800d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Deleting offline snapshot 8e4a3daf-5245-41fe-bff8-ad992bb3800d of volume 613a23a4-a4ec-4666-beb5-1ef42740dcb0 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:59:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] snapshot_file for this snap is: volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:59:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9a3c0c-8140-4830-85e4-9dc8b4145012]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:18 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d Jul 10 06:59:18 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:18 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d" returned: 0 in 0.851s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:59:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0fffa0-1f76-4faa-8d26-9404ab62693f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:18 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 Jul 10 06:59:18 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:19 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0" returned: 0 in 0.801s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:19 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d Jul 10 06:59:19 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:20 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d" returned: 0 in 0.775s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:20 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d Jul 10 06:59:20 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:21 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0.8e4a3daf-5245-41fe-bff8-ad992bb3800d" returned: 0 in 0.704s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-8e4a3daf-5245-41fe-bff8-ad992bb3800d" released by "_delete_snapshot" :: held 3.266s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-613a23a4-a4ec-4666-beb5-1ef42740dcb0" released by "delete_snapshot" :: held 3.297s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:21 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Created reservations ['f071734a-d6c3-4776-969b-2570ee57cd7d', 'df37cf15-6da1-4e66-ad32-3b1e9ce25ef4', '125e54a5-c2aa-45b4-97e2-7a2109e3969e', '273baa71-2e7c-4526-83f4-7b457526fb7f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Delete snapshot completed successfully. Jul 10 06:59:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ab86ee28-892f-4a72-8695-91d80ac9fe17 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-8e4a3daf-5245-41fe-bff8-ad992bb3800d-delete_snapshot" released by "delete_snapshot" :: held 3.460s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "cinder-613a23a4-a4ec-4666-beb5-1ef42740dcb0-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-613a23a4-a4ec-4666-beb5-1ef42740dcb0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "cinder-quobyte-613a23a4-a4ec-4666-beb5-1ef42740dcb0" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-613a23a4-a4ec-4666-beb5-1ef42740dcb0" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2504a282-a25d-4dd2-bac3-4cbf7df07152]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:22 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 Jul 10 06:59:22 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:23 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0" returned: 0 in 0.838s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:23 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0 Jul 10 06:59:23 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:23 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-613a23a4-a4ec-4666-beb5-1ef42740dcb0" returned: 0 in 0.699s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-613a23a4-a4ec-4666-beb5-1ef42740dcb0" released by "delete_volume" :: held 1.636s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:23 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Created reservations ['40d7f019-e591-49b8-b8bc-a5eaed65315d', '3abd3fd0-a0e7-45f7-93a2-3b8420a307a4', '02d12737-e7e7-4f11-b196-29a265983c66', '94b03cd9-84c5-4ef7-bd85-3bb7009e8709'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:23 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:59:23 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "cinder-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "cinder-quobyte-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:24 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df1efd5-2a8f-491b-8d8a-1b5b11bc49d5]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:24 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb Jul 10 06:59:24 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:24 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.850s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:24 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:24 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Deleted volume successfully. Jul 10 06:59:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0ae2a96d-5b06-41e8-8856-5cf38e88b1d6 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-613a23a4-a4ec-4666-beb5-1ef42740dcb0-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:25 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" returned: 0 in 0.830s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:25 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb Jul 10 06:59:25 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:26 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" returned: 0 in 0.650s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-quobyte-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb" released by "delete_volume" :: held 1.549s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Created reservations ['d9ec56d1-77f3-495c-8a63-58d76e5386a3', 'cc9a6e87-8975-49ee-bac4-8efe212f8a12', 'b940687a-ca94-40ff-b43e-7573abf8f548', 'd264a7be-0f81-4d75-9a2d-98e21bdf066b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:26 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:59:26 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:26 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.679s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Deleted volume successfully. Jul 10 06:59:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1412ce62-fb72-44e5-8a66-001a3725bff7 tempest-VolumeDependencyTests-1936612245 None] Lock "cinder-6e0dd934-8a85-44d6-b9a6-34ea8f62edeb-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Flow 'volume_create_manager' (ace6493e-7405-4304-8ee3-c7cb6e25f992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caafa560-1011-4a78-8296-2fefc3aa8fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caafa560-1011-4a78-8296-2fefc3aa8fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be697c2a-48e0-444a-861d-9e215a535e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2202d22b924b6193d7eb942a8bae2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:30Z,use_quota=True,user_id='4e82d9b183c0434898abf4b044d05cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f591ad68-100b-4c62-9d66-7bc7598180d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f591ad68-100b-4c62-9d66-7bc7598180d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb0b723-3510-4d14-9809-75355e455542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb0b723-3510-4d14-9809-75355e455542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be697c2a-48e0-444a-861d-9e215a535e66', 'volume_name': 'volume-be697c2a-48e0-444a-861d-9e215a535e66', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db038f11-720e-495b-b762-9f5d756c21f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db038f11-720e-495b-b762-9f5d756c21f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425cba38-697e-4844-b1e3-a0b59310bc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:29 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Volume be697c2a-48e0-444a-861d-9e215a535e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be697c2a-48e0-444a-861d-9e215a535e66', 'volume_size': 1} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be697c2a-48e0-444a-861d-9e215a535e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2202d22b924b6193d7eb942a8bae2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:30Z,use_quota=True,user_id='4e82d9b183c0434898abf4b044d05cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Creating volume be697c2a-48e0-444a-861d-9e215a535e66 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:59:29 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:59:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:29 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66 1073741824 Jul 10 06:59:29 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:30 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66 1073741824" returned: 0 in 0.809s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:30 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66 Jul 10 06:59:30 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:31 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66" returned: 0 in 0.696s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:59:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425cba38-697e-4844-b1e3-a0b59310bc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be697c2a-48e0-444a-861d-9e215a535e66', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234ee650-9262-4f67-9113-123edfbe4974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:31 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Volume volume-be697c2a-48e0-444a-861d-9e215a535e66 (be697c2a-48e0-444a-861d-9e215a535e66): created successfully Jul 10 06:59:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234ee650-9262-4f67-9113-123edfbe4974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Flow 'volume_create_manager' (ace6493e-7405-4304-8ee3-c7cb6e25f992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-71dbe5e7-4d24-40fc-b5cb-ff6b6a7f74be tempest-CinderUnicodeTest-1589016129 None] Created volume successfully. Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Flow 'volume_create_manager' (628259e6-8d57-426c-9241-af1549c8c938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f86cb54-ece7-486e-a427-7d084b8d0a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f86cb54-ece7-486e-a427-7d084b8d0a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-122393196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe2585a-5590-4404-a618-6e82adecb058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2202d22b924b6193d7eb942a8bae2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:32Z,use_quota=True,user_id='4e82d9b183c0434898abf4b044d05cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403e6d85-53f2-422b-82ec-9af90806d343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403e6d85-53f2-422b-82ec-9af90806d343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fa8341-61c9-4863-8893-3be84586ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fa8341-61c9-4863-8893-3be84586ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe2585a-5590-4404-a618-6e82adecb058', 'volume_name': 'volume-0fe2585a-5590-4404-a618-6e82adecb058', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20145acd-d9cf-4960-97f4-16ed557d2590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20145acd-d9cf-4960-97f4-16ed557d2590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6635effe-7cd0-4b1a-907a-2b7a7076ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:32 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Volume 0fe2585a-5590-4404-a618-6e82adecb058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe2585a-5590-4404-a618-6e82adecb058', 'volume_size': 1} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-122393196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe2585a-5590-4404-a618-6e82adecb058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2202d22b924b6193d7eb942a8bae2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:32Z,use_quota=True,user_id='4e82d9b183c0434898abf4b044d05cde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Creating volume 0fe2585a-5590-4404-a618-6e82adecb058 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:59:32 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:59:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:32 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 1073741824 Jul 10 06:59:32 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:33 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 1073741824" returned: 0 in 0.829s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:33 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 Jul 10 06:59:33 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:34 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058" returned: 0 in 0.647s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6635effe-7cd0-4b1a-907a-2b7a7076ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe2585a-5590-4404-a618-6e82adecb058', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b088ce-72f7-47e1-b9a7-a6fc0d4c4746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:34 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Volume volume-0fe2585a-5590-4404-a618-6e82adecb058 (0fe2585a-5590-4404-a618-6e82adecb058): created successfully Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b088ce-72f7-47e1-b9a7-a6fc0d4c4746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Flow 'volume_create_manager' (628259e6-8d57-426c-9241-af1549c8c938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b4d50591-dcf5-4f8b-a400-201c42757ed4 tempest-CinderUnicodeTest-1589016129 None] Created volume successfully. Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] Creating offline snapshot 6fb166e5-2473-41c7-9ca5-24fb0551dd90 of volume 0fe2585a-5590-4404-a618-6e82adecb058 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0260a22f-db2b-4762-a221-9fd01bb843aa]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:34 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 Jul 10 06:59:34 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:35 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058" returned: 0 in 0.758s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:35 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 1G Jul 10 06:59:35 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:36 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 1G" returned: 0 in 0.809s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe2585a-5590-4404-a618-6e82adecb058 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:36 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe2585a-5590-4404-a618-6e82adecb058 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 Jul 10 06:59:36 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:36 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe2585a-5590-4404-a618-6e82adecb058 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90" returned: 0 in 0.668s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:36 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 is being set with open permissions: ugo+rw Jul 10 06:59:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:36 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 Jul 10 06:59:36 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:37 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90" returned: 0 in 0.644s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:37 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.info Jul 10 06:59:37 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:38 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.info" returned: 0 in 0.639s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:38 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.info is being set with open permissions: ugo+rw Jul 10 06:59:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:38 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.info Jul 10 06:59:38 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:38 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.info" returned: 0 in 0.641s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.240s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bf656f56-a177-4343-b0f1-98448932bf50 tempest-CinderUnicodeTest-1589016129 None] Create snapshot completed successfully Jul 10 06:59:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "cinder-6fb166e5-2473-41c7-9ca5-24fb0551dd90-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-6fb166e5-2473-41c7-9ca5-24fb0551dd90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "cinder-quobyte-0fe2585a-5590-4404-a618-6e82adecb058" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-quobyte-0fe2585a-5590-4404-a618-6e82adecb058" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "cinder-quobyte-6fb166e5-2473-41c7-9ca5-24fb0551dd90" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-quobyte-6fb166e5-2473-41c7-9ca5-24fb0551dd90" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Deleting offline snapshot 6fb166e5-2473-41c7-9ca5-24fb0551dd90 of volume 0fe2585a-5590-4404-a618-6e82adecb058 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:59:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] snapshot_file for this snap is: volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:59:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[741cedfc-728c-46fe-b030-889fda24fd7a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:40 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 Jul 10 06:59:40 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:40 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90" returned: 0 in 0.790s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe2585a-5590-4404-a618-6e82adecb058(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:59:40 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[22db0622-1f79-4c9a-8e90-ffa49b3eaa1b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:40 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 Jul 10 06:59:40 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:41 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:41 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 Jul 10 06:59:41 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:42 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90" returned: 0 in 0.744s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:42 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90 Jul 10 06:59:42 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:42 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058.6fb166e5-2473-41c7-9ca5-24fb0551dd90" returned: 0 in 0.629s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-quobyte-6fb166e5-2473-41c7-9ca5-24fb0551dd90" released by "_delete_snapshot" :: held 3.056s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-quobyte-0fe2585a-5590-4404-a618-6e82adecb058" released by "delete_snapshot" :: held 3.080s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:43 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Created reservations ['afddc33f-a12d-4657-a615-8ec1c4a445ef', 'ecffdcef-b10e-4116-b381-7db550299a3a', '799aaa72-f63d-499a-8e2c-906688f54a28', '9e922035-ce9c-470d-8ce6-b09dd0eec1d9'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Delete snapshot completed successfully. Jul 10 06:59:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-016c22dc-52a7-4e40-a494-229decebbb5e tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-6fb166e5-2473-41c7-9ca5-24fb0551dd90-delete_snapshot" released by "delete_snapshot" :: held 3.219s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "cinder-0fe2585a-5590-4404-a618-6e82adecb058-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-0fe2585a-5590-4404-a618-6e82adecb058-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "cinder-quobyte-0fe2585a-5590-4404-a618-6e82adecb058" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-quobyte-0fe2585a-5590-4404-a618-6e82adecb058" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d686b3-ebf0-4493-b882-d558735eebc9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:44 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 Jul 10 06:59:44 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:44 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058" returned: 0 in 0.765s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:45 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058 Jul 10 06:59:45 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:45 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-0fe2585a-5590-4404-a618-6e82adecb058" returned: 0 in 0.668s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-quobyte-0fe2585a-5590-4404-a618-6e82adecb058" released by "delete_volume" :: held 1.490s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:45 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Created reservations ['f27234ea-dfb4-4097-82a6-406acb5e873d', '0be58571-4955-4c92-8caf-395159e781e1', 'c53a9adc-1037-4196-bc0b-32db896ee185', '28d33741-d642-42c0-af24-333b52924e41'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:45 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:59:45 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "cinder-be697c2a-48e0-444a-861d-9e215a535e66-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-be697c2a-48e0-444a-861d-9e215a535e66-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:46 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:INSERT=23,cinder:UPDATE=79,cinder:SELECT=66,cinder:DELETE=8 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:59:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "cinder-quobyte-be697c2a-48e0-444a-861d-9e215a535e66" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-quobyte-be697c2a-48e0-444a-861d-9e215a535e66" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:46 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.672s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:46 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2e38de-227e-42be-8a30-34f7d35d990c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Deleted volume successfully. Jul 10 06:59:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff4725eb-d6b9-4f42-a45f-62caea2f4271 tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-0fe2585a-5590-4404-a618-6e82adecb058-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:46 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66 Jul 10 06:59:46 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:47 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66" returned: 0 in 0.797s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:47 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66 Jul 10 06:59:47 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:47 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=56,cinder:INSERT=18,cinder:UPDATE=77,cinder:DELETE=4 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:59:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0f605b8e-f8b9-4477-b335-1dc22ed123db req-d53ff7e4-b1ef-4a70-aa63-ddcbf9d780e8 tempest-TestStampPattern-926077374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0f605b8e-f8b9-4477-b335-1dc22ed123db req-d53ff7e4-b1ef-4a70-aa63-ddcbf9d780e8 tempest-TestStampPattern-926077374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dca91cb-168b-43ce-b69d-1beab74cee19]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-0f605b8e-f8b9-4477-b335-1dc22ed123db req-d53ff7e4-b1ef-4a70-aa63-ddcbf9d780e8 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:47 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 Jul 10 06:59:47 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:47 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be697c2a-48e0-444a-861d-9e215a535e66" returned: 0 in 0.691s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-quobyte-be697c2a-48e0-444a-861d-9e215a535e66" released by "delete_volume" :: held 1.535s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Created reservations ['bd928c94-24cc-45b4-a541-6ce602745a77', '4949f1f0-edf2-4706-89af-4085ed6388dc', '70693150-9c51-4b62-9345-e7b4b13ea402', '781bf1b0-4b3e-4ff0-bf99-c07485cbc055'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:48 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:59:48 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:48 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-0f605b8e-f8b9-4477-b335-1dc22ed123db req-d53ff7e4-b1ef-4a70-aa63-ddcbf9d780e8 tempest-TestStampPattern-926077374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96" returned: 0 in 0.797s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-0f605b8e-f8b9-4477-b335-1dc22ed123db req-d53ff7e4-b1ef-4a70-aa63-ddcbf9d780e8 tempest-TestStampPattern-926077374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.817s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-0f605b8e-f8b9-4477-b335-1dc22ed123db req-d53ff7e4-b1ef-4a70-aa63-ddcbf9d780e8 tempest-TestStampPattern-926077374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-5d229056-cd8f-4f46-9d78-89838b2d7a96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9bae5d7-507f-4d89-a590-300074c7e9f9', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:59:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-0f605b8e-f8b9-4477-b335-1dc22ed123db req-d53ff7e4-b1ef-4a70-aa63-ddcbf9d780e8 tempest-TestStampPattern-926077374 None] attachment_update completed successfully. Jul 10 06:59:48 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.751s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Deleted volume successfully. Jul 10 06:59:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a80287fb-107b-4fbf-b8d8-d4b4098590c8 tempest-CinderUnicodeTest-1589016129 None] Lock "cinder-be697c2a-48e0-444a-861d-9e215a535e66-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Flow 'volume_create_manager' (0486f9b0-0219-4ae5-8f42-e303a7630714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed0e0b4-734f-40fe-9e2a-cd124db71e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed0e0b4-734f-40fe-9e2a-cd124db71e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187288916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a069d3b9444705ba18561f4ec06d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:52Z,use_quota=True,user_id='61515c6c81cd44d48b747e48ef34422a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6317d550-ceec-40a5-b916-a24d13c9b84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6317d550-ceec-40a5-b916-a24d13c9b84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be6c9f8-d0df-46d1-bfda-315eaf5c3aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be6c9f8-d0df-46d1-bfda-315eaf5c3aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9', 'volume_name': 'volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a83a247-6f9e-495e-b83e-7db95d7d78f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a83a247-6f9e-495e-b83e-7db95d7d78f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb75128-43a6-4a01-8d77-a2e5565a0dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:52 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Volume 9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9', 'volume_size': 1} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1187288916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a069d3b9444705ba18561f4ec06d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:52Z,use_quota=True,user_id='61515c6c81cd44d48b747e48ef34422a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Creating volume 9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:59:52 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:59:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:52 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9 1073741824 Jul 10 06:59:52 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:53 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9 1073741824" returned: 0 in 0.956s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:53 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9 Jul 10 06:59:53 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:53 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9" returned: 0 in 0.764s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:59:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb75128-43a6-4a01-8d77-a2e5565a0dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4117b2e-359a-45bc-98fe-740dead55b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Volume volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9 (9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9): created successfully Jul 10 06:59:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4117b2e-359a-45bc-98fe-740dead55b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Flow 'volume_create_manager' (0486f9b0-0219-4ae5-8f42-e303a7630714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d9d3123b-a3e8-4042-8bf4-0f923376dc8c tempest-ProjectReaderTests-574651992 None] Created volume successfully. Jul 10 06:59:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Acquiring lock "cinder-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Lock "cinder-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Acquiring lock "cinder-quobyte-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Lock "cinder-quobyte-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[44360951-a1ae-4616-890a-a933272d5d34]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:54 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9 Jul 10 06:59:54 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:55 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9" returned: 0 in 0.849s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:55 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9 Jul 10 06:59:55 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:55 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9" returned: 0 in 0.650s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Lock "cinder-quobyte-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9" released by "delete_volume" :: held 1.542s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:56 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Created reservations ['d92e6890-b193-4799-a568-aac1035f5643', '25d72c5b-6e12-427c-95a9-2d463f64f705', '61b43ef0-3fd4-4942-92b3-2924c8660d8f', 'def2860b-5cb7-4f89-afe7-49d80511b63c'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:56 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 06:59:56 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:56 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.653s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:56 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Deleted volume successfully. Jul 10 06:59:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-afaa6929-8cca-4ebc-a118-88b04390205e tempest-ProjectReaderTests-574651992 None] Lock "cinder-9ef171b0-5788-4f1d-a2b6-c101fdb3b4c9-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Flow 'volume_create_manager' (699abc82-5d41-4b5f-b268-c6cce118c97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df6ac97-547a-49dc-82c8-fd8118379023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df6ac97-547a-49dc-82c8-fd8118379023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1294195770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eefde13-38c7-4a65-a094-9e4e41e2b612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a069d3b9444705ba18561f4ec06d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:57Z,use_quota=True,user_id='61515c6c81cd44d48b747e48ef34422a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ed94fb-d0fd-4165-931b-3565fc1fb01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ed94fb-d0fd-4165-931b-3565fc1fb01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6839f2c2-d249-42ed-8f90-41bbaf73fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6839f2c2-d249-42ed-8f90-41bbaf73fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eefde13-38c7-4a65-a094-9e4e41e2b612', 'volume_name': 'volume-1eefde13-38c7-4a65-a094-9e4e41e2b612', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd28a5c6-73fd-4359-a036-70b8c5a6d488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd28a5c6-73fd-4359-a036-70b8c5a6d488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d40e30e-7a6d-458a-b015-2c87a670cd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Volume 1eefde13-38c7-4a65-a094-9e4e41e2b612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eefde13-38c7-4a65-a094-9e4e41e2b612', 'volume_size': 1} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1294195770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eefde13-38c7-4a65-a094-9e4e41e2b612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04a069d3b9444705ba18561f4ec06d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:57Z,use_quota=True,user_id='61515c6c81cd44d48b747e48ef34422a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Creating volume 1eefde13-38c7-4a65-a094-9e4e41e2b612 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:59:57 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-34c9ffd8-7aaa-4771-9e20-a93a4c6ad023 req-2d1b2a9d-cfa1-4ab5-82dd-939870bbf776 tempest-TestStampPattern-926077374 None] Terminate volume connection completed successfully. Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-34c9ffd8-7aaa-4771-9e20-a93a4c6ad023 req-2d1b2a9d-cfa1-4ab5-82dd-939870bbf776 tempest-TestStampPattern-926077374 None] Deleting attachment c9bae5d7-507f-4d89-a590-300074c7e9f9. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:59:57 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612 1073741824 Jul 10 06:59:57 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:57 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612 1073741824" returned: 0 in 0.833s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:58 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612 Jul 10 06:59:58 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:58 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612" returned: 0 in 0.654s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:59:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d40e30e-7a6d-458a-b015-2c87a670cd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eefde13-38c7-4a65-a094-9e4e41e2b612', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9877d758-f195-40af-b9cc-4244037a1dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:58 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Volume volume-1eefde13-38c7-4a65-a094-9e4e41e2b612 (1eefde13-38c7-4a65-a094-9e4e41e2b612): created successfully Jul 10 06:59:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9877d758-f195-40af-b9cc-4244037a1dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Flow 'volume_create_manager' (699abc82-5d41-4b5f-b268-c6cce118c97f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:58 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3dcb6d42-da6d-42e8-9b2d-a7590731a85e tempest-ProjectReaderTests-574651992 None] Created volume successfully. Jul 10 06:59:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Acquiring lock "cinder-1eefde13-38c7-4a65-a094-9e4e41e2b612-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Lock "cinder-1eefde13-38c7-4a65-a094-9e4e41e2b612-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Acquiring lock "cinder-quobyte-1eefde13-38c7-4a65-a094-9e4e41e2b612" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] Creating offline snapshot 6d4403f7-9d54-48f0-86f1-91a10fa3645e of volume 5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:59:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Lock "cinder-quobyte-1eefde13-38c7-4a65-a094-9e4e41e2b612" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafa0021-7794-4827-9ee1-ede936049c36]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e382398-ddef-4a53-80ad-ae5e702ba009]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:59 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 Jul 10 06:59:59 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:59 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612 Jul 10 06:59:59 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:00 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612" returned: 0 in 0.757s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:00 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96" returned: 0 in 0.783s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:00 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612 Jul 10 07:00:00 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:00 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e 1G Jul 10 07:00:00 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:00 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1eefde13-38c7-4a65-a094-9e4e41e2b612" returned: 0 in 0.687s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Lock "cinder-quobyte-1eefde13-38c7-4a65-a094-9e4e41e2b612" released by "delete_volume" :: held 1.485s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Created reservations ['f3fe44f4-d044-4399-aac8-b2678d4e7825', '258e5de0-bc19-4c9b-8099-a6e16d02cbd8', 'c9a0ac46-ef80-4e64-9e76-bb00ff07f418', '35ffd6b2-fd40-4bad-887a-70472c8f2b98'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:00 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e 1G" returned: 0 in 0.813s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:00 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:00:00 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:00 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e Jul 10 07:00:00 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:01 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.719s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:01 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:00:01 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Deleted volume successfully. Jul 10 07:00:01 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e" returned: 0 in 0.725s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:01 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e is being set with open permissions: ugo+rw Jul 10 07:00:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:01 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e Jul 10 07:00:01 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:01 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-2599ec6a-a831-45ee-8b9f-148e9f5003f4 tempest-ProjectReaderTests-574651992 None] Lock "cinder-1eefde13-38c7-4a65-a094-9e4e41e2b612-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:02 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e" returned: 0 in 0.648s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:02 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.info Jul 10 07:00:02 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:03 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.info" returned: 0 in 0.738s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:03 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.info is being set with open permissions: ugo+rw Jul 10 07:00:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:03 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.info Jul 10 07:00:03 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:03 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.info" returned: 0 in 0.705s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.521s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6dfd9ec1-2247-43cd-addf-3c9888972c4d tempest-TestStampPattern-926077374 None] Create snapshot completed successfully Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Flow 'volume_create_manager' (0436cad8-e37f-4fd0-8af8-41929af6ae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b04a74-a1c7-4f2e-9b11-3319838333d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b04a74-a1c7-4f2e-9b11-3319838333d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394827049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282c36e7-d21c-4b05-bf27-e87c359ecc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a7b858944624aafa0ea10e487325388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:05Z,use_quota=True,user_id='68b60326874549b5b1063d94d418a3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196e0b92-fc84-4b9b-9653-423d1f622059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196e0b92-fc84-4b9b-9653-423d1f622059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1637fe-ea29-47c4-b0cf-90a52b5cbe89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1637fe-ea29-47c4-b0cf-90a52b5cbe89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '282c36e7-d21c-4b05-bf27-e87c359ecc16', 'volume_name': 'volume-282c36e7-d21c-4b05-bf27-e87c359ecc16', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28e30a4-b26a-4242-8838-2a9ec0dfafdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28e30a4-b26a-4242-8838-2a9ec0dfafdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca3f2b3-a1d7-4ad1-bf0a-6867f074e9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Volume 282c36e7-d21c-4b05-bf27-e87c359ecc16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-282c36e7-d21c-4b05-bf27-e87c359ecc16', 'volume_size': 1} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394827049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=282c36e7-d21c-4b05-bf27-e87c359ecc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a7b858944624aafa0ea10e487325388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:05Z,use_quota=True,user_id='68b60326874549b5b1063d94d418a3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Creating volume 282c36e7-d21c-4b05-bf27-e87c359ecc16 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:00:05 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:00:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:05 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16 1073741824 Jul 10 07:00:05 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:06 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16 1073741824" returned: 0 in 0.843s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:06 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16 Jul 10 07:00:06 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:06 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16" returned: 0 in 0.661s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:00:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca3f2b3-a1d7-4ad1-bf0a-6867f074e9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-282c36e7-d21c-4b05-bf27-e87c359ecc16', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a12f03-fa79-487d-95b4-8d3b8acb9b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Volume volume-282c36e7-d21c-4b05-bf27-e87c359ecc16 (282c36e7-d21c-4b05-bf27-e87c359ecc16): created successfully Jul 10 07:00:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a12f03-fa79-487d-95b4-8d3b8acb9b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Flow 'volume_create_manager' (0436cad8-e37f-4fd0-8af8-41929af6ae3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0a53951d-f85b-42b0-94d7-301bec21bd34 tempest-ProjectReaderTests-1401065756 None] Created volume successfully. Jul 10 07:00:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "cinder-282c36e7-d21c-4b05-bf27-e87c359ecc16-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-282c36e7-d21c-4b05-bf27-e87c359ecc16-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "cinder-quobyte-282c36e7-d21c-4b05-bf27-e87c359ecc16" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-quobyte-282c36e7-d21c-4b05-bf27-e87c359ecc16" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fad4f6-3ed8-4a02-a063-12f247040396]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:07 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16 Jul 10 07:00:07 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:08 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16" returned: 0 in 0.780s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:08 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16 Jul 10 07:00:08 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:08 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-282c36e7-d21c-4b05-bf27-e87c359ecc16" returned: 0 in 0.644s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-quobyte-282c36e7-d21c-4b05-bf27-e87c359ecc16" released by "delete_volume" :: held 1.466s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:08 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Created reservations ['646adb2b-9d8d-415f-83c9-0632632e50be', '6173c374-9711-4372-9a77-0edd97814982', 'c863492f-0fec-4223-be9c-b5967366f4d1', '5963baa4-71f7-476f-a3c1-b71ade7eb792'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:09 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:00:09 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:09 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.729s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:09 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:00:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Deleted volume successfully. Jul 10 07:00:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3a55ced9-a205-4213-b865-dadf7ee37539 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-282c36e7-d21c-4b05-bf27-e87c359ecc16-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Flow 'volume_create_manager' (290114f8-844d-43e8-849f-a68d0542edc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86399f5-5fde-48b3-8a98-24d236022bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86399f5-5fde-48b3-8a98-24d236022bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494033829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b283b6-c11b-42c4-a82c-aca1298a95ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a7b858944624aafa0ea10e487325388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:10Z,use_quota=True,user_id='68b60326874549b5b1063d94d418a3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018c8148-f5ae-40b7-b85e-527b77c47e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018c8148-f5ae-40b7-b85e-527b77c47e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533ae820-3e49-48bf-bc24-f229a6d22357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533ae820-3e49-48bf-bc24-f229a6d22357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b283b6-c11b-42c4-a82c-aca1298a95ae', 'volume_name': 'volume-47b283b6-c11b-42c4-a82c-aca1298a95ae', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa274a5-994a-41b6-bdcb-d24231ebf3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa274a5-994a-41b6-bdcb-d24231ebf3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384de7d8-e5d7-4a1a-aa8a-247dcc349108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:10 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Volume 47b283b6-c11b-42c4-a82c-aca1298a95ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b283b6-c11b-42c4-a82c-aca1298a95ae', 'volume_size': 1} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-494033829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b283b6-c11b-42c4-a82c-aca1298a95ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a7b858944624aafa0ea10e487325388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:10Z,use_quota=True,user_id='68b60326874549b5b1063d94d418a3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Creating volume 47b283b6-c11b-42c4-a82c-aca1298a95ae {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:00:10 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:00:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:10 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae 1073741824 Jul 10 07:00:10 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:11 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae 1073741824" returned: 0 in 0.806s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:11 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae Jul 10 07:00:11 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:11 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:00:11 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:11 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae" returned: 0 in 0.683s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384de7d8-e5d7-4a1a-aa8a-247dcc349108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b283b6-c11b-42c4-a82c-aca1298a95ae', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d11592d-a915-4151-8699-a2852ffbdcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Volume volume-47b283b6-c11b-42c4-a82c-aca1298a95ae (47b283b6-c11b-42c4-a82c-aca1298a95ae): created successfully Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d11592d-a915-4151-8699-a2852ffbdcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Flow 'volume_create_manager' (290114f8-844d-43e8-849f-a68d0542edc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-2afcd4d9-2be0-4e78-918b-5c78856f89b4 tempest-ProjectReaderTests-1401065756 None] Created volume successfully. Jul 10 07:00:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Acquiring lock "cinder-47b283b6-c11b-42c4-a82c-aca1298a95ae-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Lock "cinder-47b283b6-c11b-42c4-a82c-aca1298a95ae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:12 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Acquiring lock "cinder-quobyte-47b283b6-c11b-42c4-a82c-aca1298a95ae" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.736s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:00:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:00:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:00:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:00:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Lock "cinder-quobyte-47b283b6-c11b-42c4-a82c-aca1298a95ae" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e73558-dd17-40dd-84c4-f25d07886cf3]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:12 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae Jul 10 07:00:12 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:13 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae" returned: 0 in 0.850s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:13 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae Jul 10 07:00:13 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:13 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-47b283b6-c11b-42c4-a82c-aca1298a95ae" returned: 0 in 0.652s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Lock "cinder-quobyte-47b283b6-c11b-42c4-a82c-aca1298a95ae" released by "delete_volume" :: held 1.543s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:13 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Created reservations ['35a176d7-9c65-4643-bc81-c65b29450e6b', '29e3d769-ea1a-46a2-b1f0-c977dab09e64', 'fc189a50-c6f4-4c36-a456-599160afcec8', '9068de85-bbae-47c9-b20e-c134a6172f42'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:14 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:00:14 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Flow 'volume_create_manager' (f7667f92-d198-4d68-848e-ad6b873287e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e97e6c-82d4-4567-8702-f79af2bb23c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e97e6c-82d4-4567-8702-f79af2bb23c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-402626425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72246d85-c12c-4a6c-94f4-8d9a4f51c549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7861d2797de5494298b9f3263016ad43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d4403f7-9d54-48f0-86f1-91a10fa3645e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:15Z,use_quota=True,user_id='938d6cdd6d084db7acadf03c4c54fc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff14900-c60c-4b66-8bd8-3429e911381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff14900-c60c-4b66-8bd8-3429e911381f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:14 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771c7555-a786-41d1-9e14-43a38119e264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771c7555-a786-41d1-9e14-43a38119e264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '72246d85-c12c-4a6c-94f4-8d9a4f51c549', 'volume_name': 'volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549', 'volume_size': 1, 'snapshot_id': '6d4403f7-9d54-48f0-86f1-91a10fa3645e'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae02642-c41b-421b-a3d4-43a28a2997e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae02642-c41b-421b-a3d4-43a28a2997e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c39450-6929-4843-8965-e97bcd197291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Volume 72246d85-c12c-4a6c-94f4-8d9a4f51c549: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549', 'volume_size': 1, 'snapshot_id': '6d4403f7-9d54-48f0-86f1-91a10fa3645e'} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.732s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Acquiring lock "cinder-quobyte-6d4403f7-9d54-48f0-86f1-91a10fa3645e-72246d85-c12c-4a6c-94f4-8d9a4f51c549" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Deleted volume successfully. Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-6d4403f7-9d54-48f0-86f1-91a10fa3645e-72246d85-c12c-4a6c-94f4-8d9a4f51c549" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Creating volume 72246d85-c12c-4a6c-94f4-8d9a4f51c549 from snapshot 6d4403f7-9d54-48f0-86f1-91a10fa3645e {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Acquiring lock "cinder-quobyte-72246d85-c12c-4a6c-94f4-8d9a4f51c549" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3fe2460b-5301-4d67-8a37-3e4ac07e77dd tempest-ProjectReaderTests-1401065756 None] Lock "cinder-47b283b6-c11b-42c4-a82c-aca1298a95ae-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-72246d85-c12c-4a6c-94f4-8d9a4f51c549" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] snapshot: 6d4403f7-9d54-48f0-86f1-91a10fa3645e, volume: 72246d85-c12c-4a6c-94f4-8d9a4f51c549, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec88af7-dc0a-4889-9c49-b9f650177c99]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:00:15 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e Jul 10 07:00:15 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Flow 'volume_create_manager' (5dd4f01b-2741-475b-aac1-6baae80c48ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d307cf2d-f677-4d2b-8955-fe5c01527636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d307cf2d-f677-4d2b-8955-fe5c01527636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-945059253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d66fb6e-e381-40dc-84f4-949884aa0580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a7b858944624aafa0ea10e487325388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:15Z,use_quota=True,user_id='68b60326874549b5b1063d94d418a3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e6fcd5-179b-4c1a-b33e-b4615ad8b6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e6fcd5-179b-4c1a-b33e-b4615ad8b6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d47c598-b3cc-4371-8d67-3cafe272cf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d47c598-b3cc-4371-8d67-3cafe272cf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d66fb6e-e381-40dc-84f4-949884aa0580', 'volume_name': 'volume-2d66fb6e-e381-40dc-84f4-949884aa0580', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a200ea0c-71f9-4d60-a21d-3516f0ff638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a200ea0c-71f9-4d60-a21d-3516f0ff638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb1ddb9-5ba4-438e-b87c-451468fa1253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Volume 2d66fb6e-e381-40dc-84f4-949884aa0580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d66fb6e-e381-40dc-84f4-949884aa0580', 'volume_size': 1} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:15 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e" returned: 0 in 0.856s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d229056-cd8f-4f46-9d78-89838b2d7a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ed747f-9fa2-4d5f-bd95-13700805eb1b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:15 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 Jul 10 07:00:15 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:16 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96" returned: 0 in 0.806s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:16 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:00:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:16 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 Jul 10 07:00:16 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:21 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549" returned: 0 in 5.002s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[54595747-093a-45a9-9eb3-8117b9452c13]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:21 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 Jul 10 07:00:21 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:22 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96" returned: 0 in 1.058s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:22 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:00:22 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Converted 1024.00 MB image at 204.65 MB/s Jul 10 07:00:22 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 is being set with open permissions: ugo+rw Jul 10 07:00:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:22 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 Jul 10 07:00:22 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:23 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-72246d85-c12c-4a6c-94f4-8d9a4f51c549" released by "_copy_volume_from_snapshot" :: held 8.652s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-6d4403f7-9d54-48f0-86f1-91a10fa3645e-72246d85-c12c-4a6c-94f4-8d9a4f51c549" released by "_create_volume_from_snapshot" :: held 8.699s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.725s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.351s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-945059253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d66fb6e-e381-40dc-84f4-949884aa0580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a7b858944624aafa0ea10e487325388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:15Z,use_quota=True,user_id='68b60326874549b5b1063d94d418a3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Creating volume 2d66fb6e-e381-40dc-84f4-949884aa0580 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:00:23 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:23 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580 1073741824 Jul 10 07:00:23 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c39450-6929-4843-8965-e97bcd197291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549', 'volume_size': 1, 'snapshot_id': '6d4403f7-9d54-48f0-86f1-91a10fa3645e'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6a56ac-bcdc-48f6-8d3b-522aa36f210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:23 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Volume volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 (72246d85-c12c-4a6c-94f4-8d9a4f51c549): created successfully Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6a56ac-bcdc-48f6-8d3b-522aa36f210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:23 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Flow 'volume_create_manager' (f7667f92-d198-4d68-848e-ad6b873287e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-30d28f35-0739-4e82-a31a-8ee6f5d219f8 tempest-TestStampPattern-926077374 None] Created volume successfully. Jul 10 07:00:24 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580 1073741824" returned: 0 in 0.892s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:24 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580 Jul 10 07:00:24 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:25 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580" returned: 0 in 0.710s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:00:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb1ddb9-5ba4-438e-b87c-451468fa1253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d66fb6e-e381-40dc-84f4-949884aa0580', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6036048f-1c1c-424e-9012-d9a62d2f635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Volume volume-2d66fb6e-e381-40dc-84f4-949884aa0580 (2d66fb6e-e381-40dc-84f4-949884aa0580): created successfully Jul 10 07:00:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6036048f-1c1c-424e-9012-d9a62d2f635e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Flow 'volume_create_manager' (5dd4f01b-2741-475b-aac1-6baae80c48ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-63cbf646-626d-4d60-967d-6bc69275c9bd tempest-ProjectReaderTests-1401065756 None] Created volume successfully. Jul 10 07:00:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "cinder-2d66fb6e-e381-40dc-84f4-949884aa0580-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-2d66fb6e-e381-40dc-84f4-949884aa0580-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "cinder-quobyte-2d66fb6e-e381-40dc-84f4-949884aa0580" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-quobyte-2d66fb6e-e381-40dc-84f4-949884aa0580" acquired by "delete_volume" :: waited 0.013s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[365d2ea7-756b-471b-b640-b97d18e471eb]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:26 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580 Jul 10 07:00:26 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:26 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580" returned: 0 in 0.848s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:27 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580 Jul 10 07:00:27 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:27 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2d66fb6e-e381-40dc-84f4-949884aa0580" returned: 0 in 0.692s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-quobyte-2d66fb6e-e381-40dc-84f4-949884aa0580" released by "delete_volume" :: held 1.577s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:27 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Created reservations ['f55408ef-4342-455c-b178-8aad3d86bdcf', 'a5e364ff-31db-460e-b125-0672f767e436', '79e6f3f3-04bd-4bbd-be15-6e74b3b86620', 'f3f5ad07-5316-4649-895d-496c464cfa05'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:27 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:00:27 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:28 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.768s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:00:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Deleted volume successfully. Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b32cc9cd-9238-474b-a16a-437cca814bc2 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-2d66fb6e-e381-40dc-84f4-949884aa0580-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Flow 'volume_create_manager' (215c8cc1-29d9-40e7-9c40-c930be9f3e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b06ae06-f49d-4b76-93eb-327e44f2cf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b06ae06-f49d-4b76-93eb-327e44f2cf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-459417686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1331b40a-8a3b-49f2-b8a9-61694a1b519d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a7b858944624aafa0ea10e487325388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:29Z,use_quota=True,user_id='68b60326874549b5b1063d94d418a3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbc0c38-efa7-4ea3-9bdf-28fb4a609828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbc0c38-efa7-4ea3-9bdf-28fb4a609828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38e8ca8-9919-4252-87ef-10578329703e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38e8ca8-9919-4252-87ef-10578329703e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1331b40a-8a3b-49f2-b8a9-61694a1b519d', 'volume_name': 'volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a433dee7-6096-403d-9c92-50c890f61d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a433dee7-6096-403d-9c92-50c890f61d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9497d2b-2f85-4213-bd1c-f8b396128924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Volume 1331b40a-8a3b-49f2-b8a9-61694a1b519d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d', 'volume_size': 1} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-459417686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1331b40a-8a3b-49f2-b8a9-61694a1b519d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a7b858944624aafa0ea10e487325388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:29Z,use_quota=True,user_id='68b60326874549b5b1063d94d418a3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Creating volume 1331b40a-8a3b-49f2-b8a9-61694a1b519d {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:00:28 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:00:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:29 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d 1073741824 Jul 10 07:00:29 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:29 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d 1073741824" returned: 0 in 0.980s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:30 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d Jul 10 07:00:30 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:30 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d" returned: 0 in 0.686s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:00:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9497d2b-2f85-4213-bd1c-f8b396128924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e000d72f-458d-4d43-b8f7-05e230954a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:30 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Volume volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d (1331b40a-8a3b-49f2-b8a9-61694a1b519d): created successfully Jul 10 07:00:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e000d72f-458d-4d43-b8f7-05e230954a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Flow 'volume_create_manager' (215c8cc1-29d9-40e7-9c40-c930be9f3e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3cb6e1bf-82f4-4d5c-80c5-6a8a540ccf56 tempest-ProjectReaderTests-1401065756 None] Created volume successfully. Jul 10 07:00:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "cinder-1331b40a-8a3b-49f2-b8a9-61694a1b519d-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-1331b40a-8a3b-49f2-b8a9-61694a1b519d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "cinder-quobyte-1331b40a-8a3b-49f2-b8a9-61694a1b519d" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-quobyte-1331b40a-8a3b-49f2-b8a9-61694a1b519d" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e85f0ff-21fd-419a-87e3-f0ee69922d0d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:31 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d Jul 10 07:00:31 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:31 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d" returned: 0 in 0.841s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:32 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d Jul 10 07:00:32 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:32 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1331b40a-8a3b-49f2-b8a9-61694a1b519d" returned: 0 in 0.725s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-quobyte-1331b40a-8a3b-49f2-b8a9-61694a1b519d" released by "delete_volume" :: held 1.620s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Created reservations ['34d40d8b-6210-4276-999e-fdc9169fac51', '1bf3cf60-0fdd-41e4-8a20-325ece614f7d', 'ea542c15-94b3-4ca2-900e-240dd5495555', '8159839b-6e19-4b62-898a-6cc918b2cc30'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:32 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:00:32 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:33 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.843s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:33 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:00:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Deleted volume successfully. Jul 10 07:00:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7d7f6399-56bc-43b2-9b36-c3481bddd835 tempest-ProjectReaderTests-1401065756 None] Lock "cinder-1331b40a-8a3b-49f2-b8a9-61694a1b519d-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:42 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:DELETE=6,cinder:SELECT=58,cinder:INSERT=19,cinder:UPDATE=82 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:00:43 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=58,cinder:INSERT=16,cinder:UPDATE=75,cinder:DELETE=10 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:00:54 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Flow 'volume_create_manager' (a85b56d1-14f2-409f-bfd4-a4b7437c5488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4848694-6276-481e-a5f0-0bbbdef2f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4848694-6276-481e-a5f0-0bbbdef2f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-398840867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a39057-089a-4cde-98c8-2e114ee00ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ad7bd918f7466e8aa7e70b238637ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:58Z,use_quota=True,user_id='1889489df6354807bafd71bba635e8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f522c5fc-e8e1-4e1a-90c1-f2a2c442bb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f522c5fc-e8e1-4e1a-90c1-f2a2c442bb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916f8036-d687-4241-80f9-2f7ceb974822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916f8036-d687-4241-80f9-2f7ceb974822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a39057-089a-4cde-98c8-2e114ee00ce6', 'volume_name': 'volume-f4a39057-089a-4cde-98c8-2e114ee00ce6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36e78bf-bfdc-4758-8a8d-37614bdbe0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36e78bf-bfdc-4758-8a8d-37614bdbe0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9dc0ce8-b955-42d7-9903-fbca08596c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Volume f4a39057-089a-4cde-98c8-2e114ee00ce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a39057-089a-4cde-98c8-2e114ee00ce6', 'volume_size': 1} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-398840867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a39057-089a-4cde-98c8-2e114ee00ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ad7bd918f7466e8aa7e70b238637ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:58Z,use_quota=True,user_id='1889489df6354807bafd71bba635e8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Creating volume f4a39057-089a-4cde-98c8-2e114ee00ce6 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:00:57 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:00:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:57 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 1073741824 Jul 10 07:00:57 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:58 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 1073741824" returned: 0 in 0.795s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:58 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 Jul 10 07:00:58 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:59 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6" returned: 0 in 0.636s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9dc0ce8-b955-42d7-9903-fbca08596c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a39057-089a-4cde-98c8-2e114ee00ce6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad99ecf4-409b-4585-8873-bd0608e4fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:59 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Volume volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 (f4a39057-089a-4cde-98c8-2e114ee00ce6): created successfully Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad99ecf4-409b-4585-8873-bd0608e4fc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Flow 'volume_create_manager' (a85b56d1-14f2-409f-bfd4-a4b7437c5488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-17ed76bb-aa9d-4393-8296-89c84c3ffcd1 tempest-SnapshotDependencyTests-1442650114 None] Created volume successfully. Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] Creating offline snapshot eb16fc5d-f008-4785-91e3-133adefd1553 of volume f4a39057-089a-4cde-98c8-2e114ee00ce6 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eefff9-9fa3-44da-b828-d24a727b07eb]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:00 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 Jul 10 07:01:00 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:00 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6" returned: 0 in 0.768s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:00 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 1G Jul 10 07:01:00 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:01 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 1G" returned: 0 in 0.815s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:01 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 Jul 10 07:01:01 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:02 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553" returned: 0 in 0.706s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:02 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 is being set with open permissions: ugo+rw Jul 10 07:01:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:02 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 Jul 10 07:01:02 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:02 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553" returned: 0 in 0.656s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:02 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.info Jul 10 07:01:02 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:03 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.info" returned: 0 in 0.653s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:03 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.info is being set with open permissions: ugo+rw Jul 10 07:01:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:03 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.info Jul 10 07:01:03 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:04 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.info" returned: 0 in 0.663s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.347s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-870af3ed-d584-4d7b-a1eb-ecff48b89176 tempest-SnapshotDependencyTests-1442650114 None] Create snapshot completed successfully Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Flow 'volume_create_manager' (09d08026-ae7d-49b6-b2f9-8e37cd396fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec254a27-6a77-4c77-9573-189f1b7a4e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec254a27-6a77-4c77-9573-189f1b7a4e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc4fa0c-03fa-4744-bf8d-5047a1b8581c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ad7bd918f7466e8aa7e70b238637ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb16fc5d-f008-4785-91e3-133adefd1553,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:06Z,use_quota=True,user_id='1889489df6354807bafd71bba635e8dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6dcb4b4-54dc-464b-8901-99c063576f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6dcb4b4-54dc-464b-8901-99c063576f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a01e543-1126-4081-ae2a-779ba8457a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a01e543-1126-4081-ae2a-779ba8457a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bcc4fa0c-03fa-4744-bf8d-5047a1b8581c', 'volume_name': 'volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c', 'volume_size': 1, 'snapshot_id': 'eb16fc5d-f008-4785-91e3-133adefd1553'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b73a7f-1a89-4f3e-8a87-ca18c22c37ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b73a7f-1a89-4f3e-8a87-ca18c22c37ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b80e67-f115-4b07-b89f-e40852537bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Volume bcc4fa0c-03fa-4744-bf8d-5047a1b8581c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c', 'volume_size': 1, 'snapshot_id': 'eb16fc5d-f008-4785-91e3-133adefd1553'} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "cinder-quobyte-eb16fc5d-f008-4785-91e3-133adefd1553-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-eb16fc5d-f008-4785-91e3-133adefd1553-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Creating volume bcc4fa0c-03fa-4744-bf8d-5047a1b8581c from snapshot eb16fc5d-f008-4785-91e3-133adefd1553 {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "cinder-quobyte-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] snapshot: eb16fc5d-f008-4785-91e3-133adefd1553, volume: bcc4fa0c-03fa-4744-bf8d-5047a1b8581c, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed846082-7eed-4491-9b1a-fb13bcc5fb03]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:05 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 Jul 10 07:01:05 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:06 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553" returned: 0 in 0.756s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4a39057-089a-4cde-98c8-2e114ee00ce6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:01:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:01:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:01:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aab6b8e-7c6e-4f37-8e6d-5ce8722090c7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:06 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 Jul 10 07:01:06 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:07 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6" returned: 0 in 0.750s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:07 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:01:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:07 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c Jul 10 07:01:07 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:01:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:11 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:01:11 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:12 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" returned: 0 in 4.834s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[241134ad-5f85-44c1-b9f1-21bc4e9da86c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:12 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 Jul 10 07:01:12 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:12 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.908s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:01:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:01:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:01:13 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6" returned: 0 in 0.936s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:01:13 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Converted 1024.00 MB image at 211.76 MB/s Jul 10 07:01:13 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c is being set with open permissions: ugo+rw Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:13 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c Jul 10 07:01:13 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-de25e669-0240-4096-830a-2c073b4beb60 req-fef05659-6eb7-4268-8af5-453094bfdd33 tempest-TestStampPattern-926077374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:13 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" returned: 0 in 0.635s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" released by "_copy_volume_from_snapshot" :: held 8.000s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-eb16fc5d-f008-4785-91e3-133adefd1553-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" released by "_create_volume_from_snapshot" :: held 8.024s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.038s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-de25e669-0240-4096-830a-2c073b4beb60 req-fef05659-6eb7-4268-8af5-453094bfdd33 tempest-TestStampPattern-926077374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.355s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b394e744-9412-4044-9c65-cae4d57e217b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-de25e669-0240-4096-830a-2c073b4beb60 req-fef05659-6eb7-4268-8af5-453094bfdd33 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b80e67-f115-4b07-b89f-e40852537bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c', 'volume_size': 1, 'snapshot_id': 'eb16fc5d-f008-4785-91e3-133adefd1553'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907005b1-a341-4642-afe1-534c6768d8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Volume volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c (bcc4fa0c-03fa-4744-bf8d-5047a1b8581c): created successfully Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907005b1-a341-4642-afe1-534c6768d8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Flow 'volume_create_manager' (09d08026-ae7d-49b6-b2f9-8e37cd396fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c285f95f-6816-4054-8043-e51a4208139d tempest-SnapshotDependencyTests-1442650114 None] Created volume successfully. Jul 10 07:01:13 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 Jul 10 07:01:13 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "cinder-eb16fc5d-f008-4785-91e3-133adefd1553-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-eb16fc5d-f008-4785-91e3-133adefd1553-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "cinder-quobyte-f4a39057-089a-4cde-98c8-2e114ee00ce6" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-f4a39057-089a-4cde-98c8-2e114ee00ce6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "cinder-quobyte-eb16fc5d-f008-4785-91e3-133adefd1553" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-eb16fc5d-f008-4785-91e3-133adefd1553" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Deleting offline snapshot eb16fc5d-f008-4785-91e3-133adefd1553 of volume f4a39057-089a-4cde-98c8-2e114ee00ce6 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] snapshot_file for this snap is: volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce624d4-a7bb-4515-9d72-8da316b8e733]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:14 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [req-de25e669-0240-4096-830a-2c073b4beb60 req-fef05659-6eb7-4268-8af5-453094bfdd33 tempest-TestStampPattern-926077374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [req-de25e669-0240-4096-830a-2c073b4beb60 req-fef05659-6eb7-4268-8af5-453094bfdd33 tempest-TestStampPattern-926077374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.789s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:14 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 Jul 10 07:01:14 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-de25e669-0240-4096-830a-2c073b4beb60 req-fef05659-6eb7-4268-8af5-453094bfdd33 tempest-TestStampPattern-926077374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5', 'name': 'volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fadf61a-1a33-4b2a-888b-dbb2421f884f', 'enforce_multipath': True} {{(pid=86966) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 07:01:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-de25e669-0240-4096-830a-2c073b4beb60 req-fef05659-6eb7-4268-8af5-453094bfdd33 tempest-TestStampPattern-926077374 None] attachment_update completed successfully. Jul 10 07:01:15 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553" returned: 0 in 0.812s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4a39057-089a-4cde-98c8-2e114ee00ce6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:01:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[59add52f-0020-4e68-a83b-f946debee138]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:15 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 Jul 10 07:01:15 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:16 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6" returned: 0 in 0.775s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:16 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 Jul 10 07:01:16 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:16 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553" returned: 0 in 0.719s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:16 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553 Jul 10 07:01:16 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:17 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6.eb16fc5d-f008-4785-91e3-133adefd1553" returned: 0 in 0.642s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-eb16fc5d-f008-4785-91e3-133adefd1553" released by "_delete_snapshot" :: held 3.052s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-f4a39057-089a-4cde-98c8-2e114ee00ce6" released by "delete_snapshot" :: held 3.079s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:17 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Created reservations ['c2f31d97-407a-4fc1-be38-5e41b289bcaa', 'f6d4a3af-8c31-4432-ba5b-269f129c0a8e', '53fbc4a6-242c-44fb-a4e8-29e3d6bb662a', '68977f29-4490-408a-b210-b29f51e8f090'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Delete snapshot completed successfully. Jul 10 07:01:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e39963e1-a2d8-469f-b3f8-bf0e3a98a0ce tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-eb16fc5d-f008-4785-91e3-133adefd1553-delete_snapshot" released by "delete_snapshot" :: held 3.207s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "cinder-f4a39057-089a-4cde-98c8-2e114ee00ce6-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-f4a39057-089a-4cde-98c8-2e114ee00ce6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "cinder-quobyte-f4a39057-089a-4cde-98c8-2e114ee00ce6" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-f4a39057-089a-4cde-98c8-2e114ee00ce6" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ebc6e2-bdb9-471a-9761-62b2f3290c6a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:18 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 Jul 10 07:01:18 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:19 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6" returned: 0 in 0.746s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:19 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6 Jul 10 07:01:19 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:20 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f4a39057-089a-4cde-98c8-2e114ee00ce6" returned: 0 in 0.682s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-f4a39057-089a-4cde-98c8-2e114ee00ce6" released by "delete_volume" :: held 1.480s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Created reservations ['704d87a5-7a00-44c5-810f-cb90cad13705', '3ec800b5-1e02-43e2-851c-42053c7db85d', 'd546b165-e9bd-4ee9-a255-ecc41d623404', 'd6399948-0967-415a-8e15-b4c3063dc002'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:20 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:01:20 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "cinder-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "cinder-quobyte-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[73945602-f901-41dd-8098-2aa265fe46cc]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:20 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.680s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Deleted volume successfully. Jul 10 07:01:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ac66b129-d7a0-495a-8f43-df9921d42652 tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-f4a39057-089a-4cde-98c8-2e114ee00ce6-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:21 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c Jul 10 07:01:21 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:21 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" returned: 0 in 0.789s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:21 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c Jul 10 07:01:21 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [req-3c6fd85f-43aa-4c93-be70-8fac838a0a2c req-6e6b6ddf-9b56-4e14-b8ff-877b225c6fe5 tempest-TestStampPattern-926077374 None] Terminate volume connection completed successfully. Jul 10 07:01:21 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [req-3c6fd85f-43aa-4c93-be70-8fac838a0a2c req-6e6b6ddf-9b56-4e14-b8ff-877b225c6fe5 tempest-TestStampPattern-926077374 None] Deleting attachment 1fadf61a-1a33-4b2a-888b-dbb2421f884f. {{(pid=86966) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 07:01:22 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" returned: 0 in 0.718s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-quobyte-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c" released by "delete_volume" :: held 1.545s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:22 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Created reservations ['61b93774-1de1-412b-8252-ea27456e2d26', 'ec63d3ba-cf2f-4748-9ca9-7bfd6862286b', 'c31cddce-0579-4174-9bf6-0e3932174e32', '351cf98c-95c0-4cfb-8322-0078d77b7cea'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:22 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:01:22 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:23 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.681s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:23 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Deleted volume successfully. Jul 10 07:01:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-165ee0c3-2f4b-4bc8-9bb9-ae648e8f647c tempest-SnapshotDependencyTests-1442650114 None] Lock "cinder-bcc4fa0c-03fa-4744-bf8d-5047a1b8581c-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Acquiring lock "cinder-72246d85-c12c-4a6c-94f4-8d9a4f51c549-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Lock "cinder-72246d85-c12c-4a6c-94f4-8d9a4f51c549-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Acquiring lock "cinder-quobyte-72246d85-c12c-4a6c-94f4-8d9a4f51c549" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-72246d85-c12c-4a6c-94f4-8d9a4f51c549" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f34cb08-7c1d-49fe-81a4-f938cd359ee2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:31 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 Jul 10 07:01:31 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:32 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549" returned: 0 in 0.784s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:32 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549 Jul 10 07:01:32 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:32 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-72246d85-c12c-4a6c-94f4-8d9a4f51c549" returned: 0 in 0.684s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-72246d85-c12c-4a6c-94f4-8d9a4f51c549" released by "delete_volume" :: held 1.515s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Created reservations ['ce6422ac-04d6-4020-86a4-e9c39fe2d794', 'a4d6c593-65bd-4eff-8ae6-cd65815e7b97', 'f573bfcb-73ea-4c65-b2e2-f01b4e97b5f7', '3854a6ab-4fbf-42c4-aca3-d2363c5d251d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:32 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:01:32 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:33 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.703s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Deleted volume successfully. Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ce06c7a-ec43-4ef9-a30a-ea1b0c8a08b5 tempest-TestStampPattern-926077374 None] Lock "cinder-72246d85-c12c-4a6c-94f4-8d9a4f51c549-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Acquiring lock "cinder-6d4403f7-9d54-48f0-86f1-91a10fa3645e-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Lock "cinder-6d4403f7-9d54-48f0-86f1-91a10fa3645e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Acquiring lock "cinder-quobyte-5d229056-cd8f-4f46-9d78-89838b2d7a96" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-5d229056-cd8f-4f46-9d78-89838b2d7a96" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Acquiring lock "cinder-quobyte-6d4403f7-9d54-48f0-86f1-91a10fa3645e" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-6d4403f7-9d54-48f0-86f1-91a10fa3645e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Deleting offline snapshot 6d4403f7-9d54-48f0-86f1-91a10fa3645e of volume 5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] snapshot_file for this snap is: volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[39832e7d-a58d-42c4-9e4c-8669817e7aac]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:33 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e Jul 10 07:01:33 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:34 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e" returned: 0 in 0.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d229056-cd8f-4f46-9d78-89838b2d7a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:01:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c79814-4718-4025-ae47-0640fb6f80d0]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:34 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 Jul 10 07:01:34 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:35 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96" returned: 0 in 0.753s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:35 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e Jul 10 07:01:35 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:36 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e" returned: 0 in 0.717s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:36 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e Jul 10 07:01:36 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:36 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96.6d4403f7-9d54-48f0-86f1-91a10fa3645e" returned: 0 in 0.632s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-6d4403f7-9d54-48f0-86f1-91a10fa3645e" released by "_delete_snapshot" :: held 2.945s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-5d229056-cd8f-4f46-9d78-89838b2d7a96" released by "delete_snapshot" :: held 2.965s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:36 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Created reservations ['af32f7c0-2058-46c9-bc62-29cb7409232c', 'bbf232f2-615c-4573-a56c-5a47a4eead53', '5c212470-c9a9-4459-89b5-7bb73c57ffa2', 'a569891b-c90e-4e8c-8883-19cce46881c2'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Delete snapshot completed successfully. Jul 10 07:01:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b923182f-caf8-4536-bccf-8f4802032b96 tempest-TestStampPattern-926077374 None] Lock "cinder-6d4403f7-9d54-48f0-86f1-91a10fa3645e-delete_snapshot" released by "delete_snapshot" :: held 3.088s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Acquiring lock "cinder-5d229056-cd8f-4f46-9d78-89838b2d7a96-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Lock "cinder-5d229056-cd8f-4f46-9d78-89838b2d7a96-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Acquiring lock "cinder-quobyte-5d229056-cd8f-4f46-9d78-89838b2d7a96" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-5d229056-cd8f-4f46-9d78-89838b2d7a96" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:45 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59a36e3-4d31-4dbc-9491-7f672de099a3]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:45 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 Jul 10 07:01:45 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:45 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96" returned: 0 in 0.751s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:45 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96 Jul 10 07:01:45 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:46 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d229056-cd8f-4f46-9d78-89838b2d7a96" returned: 0 in 0.632s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Lock "cinder-quobyte-5d229056-cd8f-4f46-9d78-89838b2d7a96" released by "delete_volume" :: held 1.434s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:46 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Created reservations ['16c2e6c0-b3c5-4db3-999a-a526ab0972f7', '553ac897-58be-4eb7-b93d-91a962f90c05', 'db648ffc-dae0-4e66-80d6-4b706b7ba319', 'f8973339-6e27-481e-8ce0-1716cea9c142'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:46 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:01:46 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:47 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.646s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:47 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Deleted volume successfully. Jul 10 07:01:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-eae8c576-c1c1-45f9-b31f-431af17a5867 tempest-TestStampPattern-926077374 None] Lock "cinder-5d229056-cd8f-4f46-9d78-89838b2d7a96-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:56 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=47,cinder:SELECT=44,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:01:57 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=47,cinder:UPDATE=55,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Flow 'volume_create_manager' (62b36197-9144-4353-8803-b6056746870d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b796c525-5605-4549-ab8b-844acbd10c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b796c525-5605-4549-ab8b-844acbd10c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079524150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d784571f-0221-46fe-b330-76bbe527d03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5872895193b446ffa3cd882d0f5bb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:06Z,use_quota=True,user_id='9e1d884dcce4407db7e3696d57adff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b44f03e-5ba7-4dc8-8a0d-37cc90c14356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b44f03e-5ba7-4dc8-8a0d-37cc90c14356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39417e0-cf41-47cd-aaf5-22c3872568bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39417e0-cf41-47cd-aaf5-22c3872568bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd784571f-0221-46fe-b330-76bbe527d03b', 'volume_name': 'volume-d784571f-0221-46fe-b330-76bbe527d03b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f752726-aa16-4833-9440-6f9c6f82b726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f752726-aa16-4833-9440-6f9c6f82b726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62681ad-c99d-4248-af7b-cd23a6067e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Volume d784571f-0221-46fe-b330-76bbe527d03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d784571f-0221-46fe-b330-76bbe527d03b', 'volume_size': 1} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079524150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d784571f-0221-46fe-b330-76bbe527d03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5872895193b446ffa3cd882d0f5bb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:06Z,use_quota=True,user_id='9e1d884dcce4407db7e3696d57adff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Creating volume d784571f-0221-46fe-b330-76bbe527d03b {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:06 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:06 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b 1073741824 Jul 10 07:02:06 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (16de1959-f357-491d-8bc1-07b8e1e7b1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5330f6-91b6-4691-8dca-34cee33a7ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5330f6-91b6-4691-8dca-34cee33a7ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1610070004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f3faff-bcd4-4eab-9fab-29782d0afdd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:07Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9d841e-bfa5-44de-8b7e-292125d73a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9d841e-bfa5-44de-8b7e-292125d73a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a69e74-1b50-45c2-86cd-a88d2fa60d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a69e74-1b50-45c2-86cd-a88d2fa60d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60f3faff-bcd4-4eab-9fab-29782d0afdd2', 'volume_name': 'volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28506aca-7599-48d5-b5ea-1b9103f047ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28506aca-7599-48d5-b5ea-1b9103f047ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c6facb-4b14-4230-a8a0-b9d3c8ac2e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume 60f3faff-bcd4-4eab-9fab-29782d0afdd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2', 'volume_size': 1} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Flow 'volume_create_manager' (47488944-6464-495d-8ab4-2f442d69286b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ebaf15-541a-415e-93fc-e02fb1eef5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ebaf15-541a-415e-93fc-e02fb1eef5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635793685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f70b57c-8d4a-461b-a141-033c59d8d4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5872895193b446ffa3cd882d0f5bb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:07Z,use_quota=True,user_id='9e1d884dcce4407db7e3696d57adff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de49981f-0d02-48bf-982d-331c1ca34f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de49981f-0d02-48bf-982d-331c1ca34f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6eab5d-a0a7-49f6-9913-d8c3ddfd9aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6eab5d-a0a7-49f6-9913-d8c3ddfd9aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f70b57c-8d4a-461b-a141-033c59d8d4dd', 'volume_name': 'volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230f5294-ed2c-4076-871b-5d05394f87f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230f5294-ed2c-4076-871b-5d05394f87f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fb07a3-16e8-4175-9851-b4796053be8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:06 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Volume 1f70b57c-8d4a-461b-a141-033c59d8d4dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd', 'volume_size': 1} Jul 10 07:02:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (4ac9ee64-031d-45ac-a965-e558c360bb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c502b901-e14b-4115-9c62-d9fe6968b351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Flow 'volume_create_manager' (e90f83c6-4177-4508-be9c-06ed3369ff18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7729af9f-97ca-49fc-90f7-39bf82318f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c502b901-e14b-4115-9c62-d9fe6968b351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1285653727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d322d586-72dd-41f1-a5e4-126894336103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:07Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0f3001-7078-4e6d-a3b3-7160af3466cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f0f3001-7078-4e6d-a3b3-7160af3466cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bb3af2-3b89-48f7-9513-59439abad4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bb3af2-3b89-48f7-9513-59439abad4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd322d586-72dd-41f1-a5e4-126894336103', 'volume_name': 'volume-d322d586-72dd-41f1-a5e4-126894336103', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40b9792-f907-4b48-9928-6904f8ec2a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40b9792-f907-4b48-9928-6904f8ec2a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e0a038-1e04-4722-b4d3-a77bd223abc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume d322d586-72dd-41f1-a5e4-126894336103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d322d586-72dd-41f1-a5e4-126894336103', 'volume_size': 1} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7729af9f-97ca-49fc-90f7-39bf82318f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1325558194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74c20a3-6e71-49ac-a9ea-5ddf4f208150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5872895193b446ffa3cd882d0f5bb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:07Z,use_quota=True,user_id='9e1d884dcce4407db7e3696d57adff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b76bd0f-1ad5-4fff-bf86-ad43642fc6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b76bd0f-1ad5-4fff-bf86-ad43642fc6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0414b8f-cb33-4ea0-b8cc-cbb8c9cf3648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0414b8f-cb33-4ea0-b8cc-cbb8c9cf3648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e74c20a3-6e71-49ac-a9ea-5ddf4f208150', 'volume_name': 'volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9e7a1e-ec3f-4c77-93f8-6cc7875e3144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9e7a1e-ec3f-4c77-93f8-6cc7875e3144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14b3a2d-cdd6-491c-8e80-ff6f7db5fba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Volume e74c20a3-6e71-49ac-a9ea-5ddf4f208150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150', 'volume_size': 1} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Flow 'volume_create_manager' (6d32832b-5b66-4699-8800-52b039668039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fc2a54-b022-4aa1-8a1e-3f689cfaf4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fc2a54-b022-4aa1-8a1e-3f689cfaf4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-125660395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc864c3-ad42-4050-82f4-e64d89c64760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5872895193b446ffa3cd882d0f5bb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:08Z,use_quota=True,user_id='9e1d884dcce4407db7e3696d57adff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba91da1-96da-44dd-8349-43f5087b5abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba91da1-96da-44dd-8349-43f5087b5abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f28b8c-bb6c-44ef-8d89-8c8ee1be7701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f28b8c-bb6c-44ef-8d89-8c8ee1be7701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc864c3-ad42-4050-82f4-e64d89c64760', 'volume_name': 'volume-1bc864c3-ad42-4050-82f4-e64d89c64760', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b0d4d8-13f1-4844-8d09-9b0133d78bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b0d4d8-13f1-4844-8d09-9b0133d78bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77175fe9-49d0-4e3b-b2ff-5fcdfad28fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Volume 1bc864c3-ad42-4050-82f4-e64d89c64760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc864c3-ad42-4050-82f4-e64d89c64760', 'volume_size': 1} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:07 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b 1073741824" returned: 0 in 1.235s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:07 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b Jul 10 07:02:07 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Flow 'volume_create_manager' (dbad4022-2b61-47b9-86ca-7770aa9bec37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237be60a-421a-4aaa-b135-dd5b5b03dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237be60a-421a-4aaa-b135-dd5b5b03dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-890500895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517beee8-035e-4208-9de6-4b03cbf50216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5872895193b446ffa3cd882d0f5bb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:08Z,use_quota=True,user_id='9e1d884dcce4407db7e3696d57adff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8d3b43-a156-499a-a9a9-06ffb754c7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8d3b43-a156-499a-a9a9-06ffb754c7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9658e91-8aae-4fef-8eca-98dfdc0ee5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9658e91-8aae-4fef-8eca-98dfdc0ee5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '517beee8-035e-4208-9de6-4b03cbf50216', 'volume_name': 'volume-517beee8-035e-4208-9de6-4b03cbf50216', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22741cf1-891b-49b6-8eb3-34bf8c18a7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22741cf1-891b-49b6-8eb3-34bf8c18a7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c762d8d6-ec3b-4937-b1be-32fe5385d54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:08 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Volume 517beee8-035e-4208-9de6-4b03cbf50216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-517beee8-035e-4208-9de6-4b03cbf50216', 'volume_size': 1} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:08 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b" returned: 0 in 0.729s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.819s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1610070004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f3faff-bcd4-4eab-9fab-29782d0afdd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:07Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Creating volume 60f3faff-bcd4-4eab-9fab-29782d0afdd2 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:08 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:08 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 1073741824 Jul 10 07:02:08 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62681ad-c99d-4248-af7b-cd23a6067e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d784571f-0221-46fe-b330-76bbe527d03b', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabcb94b-3523-4262-9b47-b497c1a5ae0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:08 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Volume volume-d784571f-0221-46fe-b330-76bbe527d03b (d784571f-0221-46fe-b330-76bbe527d03b): created successfully Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabcb94b-3523-4262-9b47-b497c1a5ae0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:08 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Flow 'volume_create_manager' (62b36197-9144-4353-8803-b6056746870d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-89e2dbc1-fbfd-497f-9ddf-570091396b67 tempest-CreateVolumesFromImageTest-1415349977 None] Created volume successfully. Jul 10 07:02:09 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 1073741824" returned: 0 in 0.845s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:09 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 Jul 10 07:02:09 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:10 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2" returned: 0 in 0.687s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.309s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1635793685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f70b57c-8d4a-461b-a141-033c59d8d4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5872895193b446ffa3cd882d0f5bb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:07Z,use_quota=True,user_id='9e1d884dcce4407db7e3696d57adff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Creating volume 1f70b57c-8d4a-461b-a141-033c59d8d4dd {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:10 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c6facb-4b14-4230-a8a0-b9d3c8ac2e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069ba37c-c951-45b5-acd5-5f356d72ab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:10 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd 1073741824 Jul 10 07:02:10 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:10 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 (60f3faff-bcd4-4eab-9fab-29782d0afdd2): created successfully Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069ba37c-c951-45b5-acd5-5f356d72ab0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (16de1959-f357-491d-8bc1-07b8e1e7b1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4fc32ec2-3db2-41ae-9cc5-f6e1c2f9ab33 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created volume successfully. Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Flow 'volume_create_manager' (80615973-5e61-4d79-928e-8016c4066708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba88504-8c50-48a5-af86-4d636e82528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba88504-8c50-48a5-af86-4d636e82528e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2642ce65-753e-4f22-b39b-79613b58f3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4661c0d771a248cdb9b3b04834212b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:11Z,use_quota=True,user_id='2e54ed0eeccd40e29ae138b33e1e8153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ee55648-3837-49c0-8008-a09dc9e3c247),volume_type_id=5ee55648-3837-49c0-8008-a09dc9e3c247)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012d1426-9d3e-4b93-86fb-c6b096b5c874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012d1426-9d3e-4b93-86fb-c6b096b5c874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d54f543-e1da-48b3-9598-dcd042797d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:10 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d54f543-e1da-48b3-9598-dcd042797d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2642ce65-753e-4f22-b39b-79613b58f3ba', 'volume_name': 'volume-2642ce65-753e-4f22-b39b-79613b58f3ba', 'volume_size': 1, 'image_id': '9ceab909-b61a-4365-b7a9-04bab20b8613', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ceab909-b61a-4365-b7a9-04bab20b8613', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1848351427c3d2f32a6721580acd3a7d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4661c0d771a248cdb9b3b04834212b37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c12a2f5fb5393839d554753b1fc323207f7f3b1b11fb54f3b13f644503bf26f5cf3547ef0b10cc6883e1e7348e4155ef8493d932e33290204fc69e697c7ee36', 'id': '9ceab909-b61a-4365-b7a9-04bab20b8613', 'created_at': datetime.datetime(2026, 7, 10, 5, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ceab909-b61a-4365-b7a9-04bab20b8613/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a208c-69b8-4606-aa3c-99b99b622c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb1a208c-69b8-4606-aa3c-99b99b622c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2001d55-890c-45d6-b6f9-d4347bd8a9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Volume 2642ce65-753e-4f22-b39b-79613b58f3ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2642ce65-753e-4f22-b39b-79613b58f3ba', 'volume_size': 1, 'image_id': '9ceab909-b61a-4365-b7a9-04bab20b8613', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ceab909-b61a-4365-b7a9-04bab20b8613', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1848351427c3d2f32a6721580acd3a7d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4661c0d771a248cdb9b3b04834212b37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c12a2f5fb5393839d554753b1fc323207f7f3b1b11fb54f3b13f644503bf26f5cf3547ef0b10cc6883e1e7348e4155ef8493d932e33290204fc69e697c7ee36', 'id': '9ceab909-b61a-4365-b7a9-04bab20b8613', 'created_at': datetime.datetime(2026, 7, 10, 5, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ceab909-b61a-4365-b7a9-04bab20b8613/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Trying to clone 2642ce65-753e-4f22-b39b-79613b58f3ba from image 9ceab909-b61a-4365-b7a9-04bab20b8613 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9ceab909-b61a-4365-b7a9-04bab20b8613', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 07:02:11 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Image download 0.00 MB at 0.00 MB/s Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e873222-7689-4840-a08f-02f8b8c21b98]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:11 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd 1073741824" returned: 0 in 1.031s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:11 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD Jul 10 07:02:11 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:11 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd Jul 10 07:02:11 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:11 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:11 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:12 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD" returned: 0 in 0.773s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:12 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd" returned: 0 in 0.702s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.499s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1285653727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d322d586-72dd-41f1-a5e4-126894336103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:07Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Creating volume d322d586-72dd-41f1-a5e4-126894336103 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:12 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:12 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103 1073741824 Jul 10 07:02:12 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fb07a3-16e8-4175-9851-b4796053be8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5517e260-9c02-4f51-93bc-c506ee6f7b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:12 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Volume volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd (1f70b57c-8d4a-461b-a141-033c59d8d4dd): created successfully Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5517e260-9c02-4f51-93bc-c506ee6f7b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:12 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD Jul 10 07:02:12 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Flow 'volume_create_manager' (47488944-6464-495d-8ab4-2f442d69286b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:12 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a3ee81cc-f18f-4ab5-9a4a-c4c06da224df tempest-CreateVolumesFromImageTest-1415349977 None] Created volume successfully. Jul 10 07:02:12 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:02:12 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD" returned: 1 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Temporary image 9ceab909-b61a-4365-b7a9-04bab20b8613 is fetched for user 2e54ed0eeccd40e29ae138b33e1e8153. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a002c03f-4fdf-421b-8ede-ba7d8250e954]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:12 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:12 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103 1073741824" returned: 0 in 0.888s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:12 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:13 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103 Jul 10 07:02:13 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:13 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD" returned: 0 in 0.745s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:13 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103" returned: 0 in 0.659s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.041s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1325558194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74c20a3-6e71-49ac-a9ea-5ddf4f208150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5872895193b446ffa3cd882d0f5bb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:07Z,use_quota=True,user_id='9e1d884dcce4407db7e3696d57adff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Creating volume e74c20a3-6e71-49ac-a9ea-5ddf4f208150 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:13 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:13 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150 1073741824 Jul 10 07:02:13 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e0a038-1e04-4722-b4d3-a77bd223abc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d322d586-72dd-41f1-a5e4-126894336103', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:13 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:13 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8512f19-5a6f-4c9e-b58f-aecf09aba6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume volume-d322d586-72dd-41f1-a5e4-126894336103 (d322d586-72dd-41f1-a5e4-126894336103): created successfully Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8512f19-5a6f-4c9e-b58f-aecf09aba6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (4ac9ee64-031d-45ac-a965-e558c360bb4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8952e0db-59b1-4e3a-b23e-93ffe669ee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created volume successfully. Jul 10 07:02:14 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD" returned: 1 in 0.726s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:02:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:14 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150 1073741824" returned: 0 in 0.837s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:14 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150 Jul 10 07:02:14 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (69ef7c0b-37dd-428a-8258-bba1806dd8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d79339-bea5-4012-8abe-21d4bc7f119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d79339-bea5-4012-8abe-21d4bc7f119e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-50185744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e40604-107a-443f-acd8-4e2e1c4ca95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:15Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db01d53f-fe46-4b69-bc75-3aeb6003cc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db01d53f-fe46-4b69-bc75-3aeb6003cc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf15493d-fae6-43e2-a3b9-cdd2e4f8b172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf15493d-fae6-43e2-a3b9-cdd2e4f8b172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e40604-107a-443f-acd8-4e2e1c4ca95c', 'volume_name': 'volume-34e40604-107a-443f-acd8-4e2e1c4ca95c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3180ad5e-e7d3-49d1-889e-51c1790aa9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3180ad5e-e7d3-49d1-889e-51c1790aa9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b0473c-3886-462c-a357-6dfc6f1b22ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume 34e40604-107a-443f-acd8-4e2e1c4ca95c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e40604-107a-443f-acd8-4e2e1c4ca95c', 'volume_size': 1} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:15 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150" returned: 0 in 0.684s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.373s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-125660395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc864c3-ad42-4050-82f4-e64d89c64760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5872895193b446ffa3cd882d0f5bb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:08Z,use_quota=True,user_id='9e1d884dcce4407db7e3696d57adff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Creating volume 1bc864c3-ad42-4050-82f4-e64d89c64760 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:15 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:15 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760 1073741824 Jul 10 07:02:15 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14b3a2d-cdd6-491c-8e80-ff6f7db5fba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8699ee-c402-4a97-b2c5-233fee3feffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Volume volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150 (e74c20a3-6e71-49ac-a9ea-5ddf4f208150): created successfully Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8699ee-c402-4a97-b2c5-233fee3feffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Flow 'volume_create_manager' (e90f83c6-4177-4508-be9c-06ed3369ff18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-373a6ca3-2b68-41e2-9174-52b77aee5f37 tempest-CreateVolumesFromImageTest-1415349977 None] Created volume successfully. Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (296d1710-902b-4197-b714-3f3eafe0156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815a986a-91bb-4db0-9913-ec8b8418be85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815a986a-91bb-4db0-9913-ec8b8418be85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1046952667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5f4194-8ed1-497c-9286-94c051167f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:15Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (140f867c-2093-49dd-a240-2e7ee01174eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (140f867c-2093-49dd-a240-2e7ee01174eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c32bd27-5b31-407a-bcb6-27ed7134b19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c32bd27-5b31-407a-bcb6-27ed7134b19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5f4194-8ed1-497c-9286-94c051167f2c', 'volume_name': 'volume-ff5f4194-8ed1-497c-9286-94c051167f2c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc94b45-e298-4ddb-8948-ac235d386cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc94b45-e298-4ddb-8948-ac235d386cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c282e5c8-f5b8-409e-912d-37c3b61010c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume ff5f4194-8ed1-497c-9286-94c051167f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5f4194-8ed1-497c-9286-94c051167f2c', 'volume_size': 1} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (0b052c4e-1a5b-4cb6-8611-bf09818103c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8959a15f-8351-4019-9e68-960d4c20d422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8959a15f-8351-4019-9e68-960d4c20d422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-592973194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2570f7a-67ed-4923-9a09-bd6b5b7de8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:16Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e249da-52cd-423d-83f4-eb326b89d893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e249da-52cd-423d-83f4-eb326b89d893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace8f57d-a294-494b-af35-392a139e1c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace8f57d-a294-494b-af35-392a139e1c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2570f7a-67ed-4923-9a09-bd6b5b7de8cb', 'volume_name': 'volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c10c406-e391-49cb-8c8f-09a263a3ea80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c10c406-e391-49cb-8c8f-09a263a3ea80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f69284f-0d99-4795-81c5-2bafa03bcc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume f2570f7a-67ed-4923-9a09-bd6b5b7de8cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb', 'volume_size': 1} Jul 10 07:02:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760 1073741824" returned: 0 in 0.928s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:16 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:16 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760 Jul 10 07:02:16 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (3582cdb9-e0ea-48f2-bac4-7bc74312858c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d5d680-7db7-4783-bda6-296052d13c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d5d680-7db7-4783-bda6-296052d13c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1529570984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9390d8-005d-4f67-8ab4-f161fd5d49ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:16Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9758a3-2c6e-4fa9-93b9-2c3784421d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9758a3-2c6e-4fa9-93b9-2c3784421d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffe670a-831e-4f4d-957e-557e74c2a118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffe670a-831e-4f4d-957e-557e74c2a118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9390d8-005d-4f67-8ab4-f161fd5d49ca', 'volume_name': 'volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cdd758-f75a-4764-9dd0-fd99429f0379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6cdd758-f75a-4764-9dd0-fd99429f0379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8880d16-99da-4d57-9448-b16320e267a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume de9390d8-005d-4f67-8ab4-f161fd5d49ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca', 'volume_size': 1} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (53c42429-51d1-4775-8b93-3497223de99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff221f80-2be9-4693-8156-bda7ea9266d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff221f80-2be9-4693-8156-bda7ea9266d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410304862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814dbd07-d06f-4a01-b246-a831cf681c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:17Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c449e3-bd4c-488a-b8cc-0b106e31c629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c449e3-bd4c-488a-b8cc-0b106e31c629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f5803e-4f80-48b1-a6d1-5247a6283f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f5803e-4f80-48b1-a6d1-5247a6283f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '814dbd07-d06f-4a01-b246-a831cf681c62', 'volume_name': 'volume-814dbd07-d06f-4a01-b246-a831cf681c62', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683ae64c-8dbb-4e10-9590-0d089c551365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683ae64c-8dbb-4e10-9590-0d089c551365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be96669-836d-44f6-83e1-4c361891e4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume 814dbd07-d06f-4a01-b246-a831cf681c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-814dbd07-d06f-4a01-b246-a831cf681c62', 'volume_size': 1} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:16 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760" returned: 0 in 0.672s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.691s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-890500895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517beee8-035e-4208-9de6-4b03cbf50216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5872895193b446ffa3cd882d0f5bb7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:08Z,use_quota=True,user_id='9e1d884dcce4407db7e3696d57adff6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Creating volume 517beee8-035e-4208-9de6-4b03cbf50216 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:16 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:16 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216 1073741824 Jul 10 07:02:16 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77175fe9-49d0-4e3b-b2ff-5fcdfad28fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc864c3-ad42-4050-82f4-e64d89c64760', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40bc5fd-36a2-4ecf-9d79-161a1f47bf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:16 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Volume volume-1bc864c3-ad42-4050-82f4-e64d89c64760 (1bc864c3-ad42-4050-82f4-e64d89c64760): created successfully Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40bc5fd-36a2-4ecf-9d79-161a1f47bf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:16 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Flow 'volume_create_manager' (6d32832b-5b66-4699-8800-52b039668039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6d2bd8df-39c6-4c53-8347-3dcc9c0085cd tempest-CreateVolumesFromImageTest-1415349977 None] Created volume successfully. Jul 10 07:02:17 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216 1073741824" returned: 0 in 0.819s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:17 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216 Jul 10 07:02:17 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:18 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216" returned: 0 in 0.643s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.331s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c762d8d6-ec3b-4937-b1be-32fe5385d54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-517beee8-035e-4208-9de6-4b03cbf50216', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06fa13d-16c2-498a-b44d-6fdd2c33ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Creating offline snapshot e8eb2e97-fe38-40d1-81fe-a63842bd5983 of volume 60f3faff-bcd4-4eab-9fab-29782d0afdd2 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:02:18 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Volume volume-517beee8-035e-4208-9de6-4b03cbf50216 (517beee8-035e-4208-9de6-4b03cbf50216): created successfully Jul 10 07:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06fa13d-16c2-498a-b44d-6fdd2c33ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:18 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Flow 'volume_create_manager' (dbad4022-2b61-47b9-86ca-7770aa9bec37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:18 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8f9757-a390-4ca5-aaeb-47ef66bbad54]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ecf11295-3988-42e7-8ff8-3900f77496bf tempest-CreateVolumesFromImageTest-1415349977 None] Created volume successfully. Jul 10 07:02:18 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 Jul 10 07:02:18 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "cinder-517beee8-035e-4208-9de6-4b03cbf50216-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-517beee8-035e-4208-9de6-4b03cbf50216-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "cinder-quobyte-517beee8-035e-4208-9de6-4b03cbf50216" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-quobyte-517beee8-035e-4208-9de6-4b03cbf50216" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae05fc6-492b-4aed-ab37-dee0ec222cfe]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:19 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216 Jul 10 07:02:19 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:19 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2" returned: 0 in 0.756s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:19 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 1G Jul 10 07:02:19 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:19 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:19 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216 Jul 10 07:02:19 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:20 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 1G" returned: 0 in 0.771s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:20 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 Jul 10 07:02:20 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:20 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-517beee8-035e-4208-9de6-4b03cbf50216" returned: 0 in 0.655s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-quobyte-517beee8-035e-4208-9de6-4b03cbf50216" released by "delete_volume" :: held 1.487s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Created reservations ['65814f20-0ec7-4e67-8353-cb57a67ac383', '2ef8f170-9f52-4474-901a-37fdeaea1e5f', '4a17255e-7fb0-4b15-958d-85053067c7d6', '24f5e780-862b-48b0-b338-ee4e9b4e00bb'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:20 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:20 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:20 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983" returned: 0 in 0.695s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:20 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 is being set with open permissions: ugo+rw Jul 10 07:02:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:20 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 Jul 10 07:02:20 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "cinder-1bc864c3-ad42-4050-82f4-e64d89c64760-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-1bc864c3-ad42-4050-82f4-e64d89c64760-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "cinder-quobyte-1bc864c3-ad42-4050-82f4-e64d89c64760" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-quobyte-1bc864c3-ad42-4050-82f4-e64d89c64760" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:21 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.662s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:21 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Deleted volume successfully. Jul 10 07:02:21 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba33b6e-7f38-49b3-bb7f-38c9a86a401e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:21 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983" returned: 0 in 0.671s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:21 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24aa49b5-9485-4042-946c-1c408e4f724a tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-517beee8-035e-4208-9de6-4b03cbf50216-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:21 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.info Jul 10 07:02:21 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:21 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760 Jul 10 07:02:21 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:22 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.info" returned: 0 in 0.666s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:22 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.info is being set with open permissions: ugo+rw Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:22 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.info Jul 10 07:02:22 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:22 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760" returned: 0 in 0.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:22 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760 Jul 10 07:02:22 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:22 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.info" returned: 0 in 0.655s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.335s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.457s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2642ce65-753e-4f22-b39b-79613b58f3ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4661c0d771a248cdb9b3b04834212b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:11Z,use_quota=True,user_id='2e54ed0eeccd40e29ae138b33e1e8153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ee55648-3837-49c0-8008-a09dc9e3c247),volume_type_id=5ee55648-3837-49c0-8008-a09dc9e3c247)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Creating volume 2642ce65-753e-4f22-b39b-79613b58f3ba {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:22 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:22 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:22 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba 1073741824 Jul 10 07:02:22 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1bc864c3-ad42-4050-82f4-e64d89c64760" returned: 0 in 0.664s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-quobyte-1bc864c3-ad42-4050-82f4-e64d89c64760" released by "delete_volume" :: held 1.495s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e4e50e72-eda9-492d-b9b3-0ae4ed18bf96 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Create snapshot completed successfully Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Created reservations ['96b3ce74-3ff0-43a8-9338-dbcc49876ed2', '02abe203-5e56-4f7d-bc79-db321e2b5b47', 'caebcb79-59cd-45f4-8eb6-1d43884da19d', 'd64c76b3-5ed4-44fe-96e4-f5cfb3df872a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:22 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:22 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "cinder-e74c20a3-6e71-49ac-a9ea-5ddf4f208150-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-e74c20a3-6e71-49ac-a9ea-5ddf4f208150-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "cinder-quobyte-e74c20a3-6e71-49ac-a9ea-5ddf4f208150" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-quobyte-e74c20a3-6e71-49ac-a9ea-5ddf4f208150" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac91a24-8c47-46c0-8cd3-39a432ebbc0e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:23 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.749s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:23 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:23 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Deleted volume successfully. Jul 10 07:02:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c9a82737-03e7-43af-bff5-f4700198dbd4 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-1bc864c3-ad42-4050-82f4-e64d89c64760-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:23 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150 Jul 10 07:02:23 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:23 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba 1073741824" returned: 0 in 0.981s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:23 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba Jul 10 07:02:23 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (10939f58-0384-4d1e-9d2e-b35e2c711c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68405aee-5586-4414-b468-8cadaf7281fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68405aee-5586-4414-b468-8cadaf7281fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879464825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ea3ea8-aed1-4ed5-928c-24e182757252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:24Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e06628-bb81-4b55-8fde-243ea628e648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e06628-bb81-4b55-8fde-243ea628e648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7c63ad-36f8-43df-93d9-4a8fe975a05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7c63ad-36f8-43df-93d9-4a8fe975a05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ea3ea8-aed1-4ed5-928c-24e182757252', 'volume_name': 'volume-83ea3ea8-aed1-4ed5-928c-24e182757252', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b625ed57-0c7c-49da-8720-ab0cfe96096e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b625ed57-0c7c-49da-8720-ab0cfe96096e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455e580d-f196-46f3-a3bd-a0a9674657b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:24 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume 83ea3ea8-aed1-4ed5-928c-24e182757252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ea3ea8-aed1-4ed5-928c-24e182757252', 'volume_size': 1} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (baa3d031-1ad8-480a-a6cc-119e654a1195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:24 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffac1935-1e47-4f62-88fd-2946f88ea39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150" returned: 0 in 0.944s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:24 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffac1935-1e47-4f62-88fd-2946f88ea39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032781421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2d571e-469b-459c-a8fb-7ff984a7c468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:24Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082342a4-37b7-4287-a0c2-393e6fc2ac03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (082342a4-37b7-4287-a0c2-393e6fc2ac03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:24 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150 Jul 10 07:02:24 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b97a63-91c3-447f-921a-e54c49c09d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b97a63-91c3-447f-921a-e54c49c09d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2d571e-469b-459c-a8fb-7ff984a7c468', 'volume_name': 'volume-8a2d571e-469b-459c-a8fb-7ff984a7c468', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f45b2b1-8204-4f85-b07d-c0575d6766b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f45b2b1-8204-4f85-b07d-c0575d6766b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11915435-ddf4-43d5-9627-9e42e3e9e6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:24 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume 8a2d571e-469b-459c-a8fb-7ff984a7c468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2d571e-469b-459c-a8fb-7ff984a7c468', 'volume_size': 1} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba" returned: 0 in 0.845s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.495s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-50185744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e40604-107a-443f-acd8-4e2e1c4ca95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:15Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Creating volume 34e40604-107a-443f-acd8-4e2e1c4ca95c {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:24 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Attempting download of 9ceab909-b61a-4365-b7a9-04bab20b8613 ((None, [{'url': 'file:///opt/stack/data/glance/images/9ceab909-b61a-4365-b7a9-04bab20b8613', 'metadata': {}}])) to volume 2642ce65-753e-4f22-b39b-79613b58f3ba. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 07:02:24 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c 1073741824 Jul 10 07:02:24 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9d7cac-ebce-438b-ac32-d33df990b378]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ceab909-b61a-4365-b7a9-04bab20b8613_2sw4gd85 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:24 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ceab909-b61a-4365-b7a9-04bab20b8613_2sw4gd85 Jul 10 07:02:24 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (47980015-be6c-4a75-8081-9b9ae1114351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:24 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855a04fa-5b1a-4d90-bcdc-a02d4b002a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855a04fa-5b1a-4d90-bcdc-a02d4b002a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635685308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b8629e-9928-4011-9239-c23084b643dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:25Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298c87fc-f1d4-44ec-9032-0a092ad85d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298c87fc-f1d4-44ec-9032-0a092ad85d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2ff1b5-a9ba-49b6-bc44-a8de9ec9291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2ff1b5-a9ba-49b6-bc44-a8de9ec9291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b8629e-9928-4011-9239-c23084b643dc', 'volume_name': 'volume-05b8629e-9928-4011-9239-c23084b643dc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3839b0f-a91d-47b7-8785-98b049ca2b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3839b0f-a91d-47b7-8785-98b049ca2b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48669f6b-47bb-45be-8ff6-4a61d1f67add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume 05b8629e-9928-4011-9239-c23084b643dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b8629e-9928-4011-9239-c23084b643dc', 'volume_size': 1} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:25 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (c2bfd5ce-31db-484e-b90a-1aadc261134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6909c079-8660-4cc1-88a6-5ab0d95f7936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-e74c20a3-6e71-49ac-a9ea-5ddf4f208150" returned: 0 in 0.970s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6909c079-8660-4cc1-88a6-5ab0d95f7936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1562799589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497bdf98-641c-4d47-8ec9-4858df49c4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:25Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87799566-4330-4ac1-98af-041374fb9151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87799566-4330-4ac1-98af-041374fb9151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f0da5f-3e9d-4699-af53-8c20bd1653e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f0da5f-3e9d-4699-af53-8c20bd1653e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497bdf98-641c-4d47-8ec9-4858df49c4c7', 'volume_name': 'volume-497bdf98-641c-4d47-8ec9-4858df49c4c7', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2f2c73-78e7-4a14-bbe9-f47fb1e0bf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2f2c73-78e7-4a14-bbe9-f47fb1e0bf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fe089c-f97c-435f-a34e-df4dfb75cb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:25 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume 497bdf98-641c-4d47-8ec9-4858df49c4c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497bdf98-641c-4d47-8ec9-4858df49c4c7', 'volume_size': 1} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-quobyte-e74c20a3-6e71-49ac-a9ea-5ddf4f208150" released by "delete_volume" :: held 2.024s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Created reservations ['e237f2d5-fcd7-41a8-80ce-b08d6efc47c9', '8dd4ccbb-93b8-4f07-a929-cf2bfff8a290', '66e2f8d7-0777-4331-a4ed-c206bb00b95e', 'b4693f23-1fd5-4d13-bd8c-3ba7432bb9a6'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:25 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ceab909-b61a-4365-b7a9-04bab20b8613_2sw4gd85" returned: 0 in 0.912s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ceab909-b61a-4365-b7a9-04bab20b8613_2sw4gd85 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:25 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:25 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:25 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ceab909-b61a-4365-b7a9-04bab20b8613_2sw4gd85 Jul 10 07:02:25 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:25 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c 1073741824" returned: 0 in 1.281s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:26 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c Jul 10 07:02:26 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (8a7d7348-6bbf-4b0b-895c-9745800c82fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7eab9d-70e6-447c-8b3e-2cd7d2f9d7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7eab9d-70e6-447c-8b3e-2cd7d2f9d7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918178981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4d96c0-0465-4717-8fe4-26a52adb87a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:26Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583b0a29-41cb-4a31-a11b-6236cfc195dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583b0a29-41cb-4a31-a11b-6236cfc195dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e19398d-59d0-4bc0-838c-4ebd4226cbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e19398d-59d0-4bc0-838c-4ebd4226cbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4d96c0-0465-4717-8fe4-26a52adb87a7', 'volume_name': 'volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2281e2af-460b-4495-81d5-9e78af4bb685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2281e2af-460b-4495-81d5-9e78af4bb685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b8a2df-f9e4-472a-83a9-7113749f23b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume 7d4d96c0-0465-4717-8fe4-26a52adb87a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7', 'volume_size': 1} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:26 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ceab909-b61a-4365-b7a9-04bab20b8613_2sw4gd85" returned: 1 in 0.790s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ceab909-b61a-4365-b7a9-04bab20b8613_2sw4gd85' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49df124-709a-4b38-bb68-1b0388b05c20]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:26 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.725s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Deleted volume successfully. Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-fd114c9f-8c26-4a8a-ba9b-f8c95a0f86b9 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-e74c20a3-6e71-49ac-a9ea-5ddf4f208150-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:26 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD Jul 10 07:02:26 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:26 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c" returned: 0 in 0.689s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.141s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1046952667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5f4194-8ed1-497c-9286-94c051167f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:15Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Creating volume ff5f4194-8ed1-497c-9286-94c051167f2c {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:26 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b0473c-3886-462c-a357-6dfc6f1b22ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e40604-107a-443f-acd8-4e2e1c4ca95c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:26 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c 1073741824 Jul 10 07:02:26 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6c9d45-eb73-4c2d-92f5-d4f0c50e8f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume volume-34e40604-107a-443f-acd8-4e2e1c4ca95c (34e40604-107a-443f-acd8-4e2e1c4ca95c): created successfully Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6c9d45-eb73-4c2d-92f5-d4f0c50e8f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (69ef7c0b-37dd-428a-8258-bba1806dd8d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bd4750f0-0c92-4d4c-becb-7c8325fbe3e4 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created volume successfully. Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "cinder-1f70b57c-8d4a-461b-a141-033c59d8d4dd-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-1f70b57c-8d4a-461b-a141-033c59d8d4dd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "cinder-quobyte-1f70b57c-8d4a-461b-a141-033c59d8d4dd" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-quobyte-1f70b57c-8d4a-461b-a141-033c59d8d4dd" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[972da7b1-d821-4430-b8e2-85d426843be6]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:27 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd Jul 10 07:02:27 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:27 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD" returned: 0 in 0.764s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:27 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD Jul 10 07:02:27 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:27 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c 1073741824" returned: 0 in 0.905s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:27 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c Jul 10 07:02:27 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:27 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd" returned: 0 in 0.833s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:27 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd Jul 10 07:02:27 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:28 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD" returned: 1 in 0.815s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] 9ceab909-b61a-4365-b7a9-04bab20b8613 was raw, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:28 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba Jul 10 07:02:28 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:28 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c" returned: 0 in 0.650s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.392s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-592973194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2570f7a-67ed-4923-9a09-bd6b5b7de8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:16Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Creating volume f2570f7a-67ed-4923-9a09-bd6b5b7de8cb {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:28 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c282e5c8-f5b8-409e-912d-37c3b61010c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5f4194-8ed1-497c-9286-94c051167f2c', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:28 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb 1073741824 Jul 10 07:02:28 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9117dd-3236-4dcf-a851-9f12f7ca3efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume volume-ff5f4194-8ed1-497c-9286-94c051167f2c (ff5f4194-8ed1-497c-9286-94c051167f2c): created successfully Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9117dd-3236-4dcf-a851-9f12f7ca3efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (296d1710-902b-4197-b714-3f3eafe0156a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dd92c69a-4c0f-43d6-89a3-d70d2c72f567 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created volume successfully. Jul 10 07:02:28 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-1f70b57c-8d4a-461b-a141-033c59d8d4dd" returned: 0 in 0.655s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-quobyte-1f70b57c-8d4a-461b-a141-033c59d8d4dd" released by "delete_volume" :: held 1.555s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Created reservations ['2b6b0354-f984-496f-ac0b-4f80a7af7878', '0775d252-3c19-4275-9374-a1d5ef2c2735', '6c4ac8ab-7ec2-4abb-b9ab-2bc086ab686a', 'fe973f86-f77e-48ca-be29-29238cc3ce74'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:28 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:28 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:28 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba" returned: 0 in 0.783s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9ceab909-b61a-4365-b7a9-04bab20b8613_p5sj80b3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:02:28 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 07:02:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:28 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba 1G Jul 10 07:02:28 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "cinder-d784571f-0221-46fe-b330-76bbe527d03b-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-d784571f-0221-46fe-b330-76bbe527d03b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "cinder-quobyte-d784571f-0221-46fe-b330-76bbe527d03b" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-quobyte-d784571f-0221-46fe-b330-76bbe527d03b" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76b19a5-8d5c-473c-944f-fd4c61d5b8b5]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:29 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb 1073741824" returned: 0 in 0.982s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:29 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.711s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:29 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Deleted volume successfully. Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:29 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b Jul 10 07:02:29 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-bd98d480-c6d2-4009-abe1-62f0a20e8982 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-1f70b57c-8d4a-461b-a141-033c59d8d4dd-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:29 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb Jul 10 07:02:29 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:29 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba 1G" returned: 0 in 0.790s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6906db90-3710-4f7c-ba22-93347c7e0bf4]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:29 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba Jul 10 07:02:29 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:30 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb" returned: 0 in 0.683s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.684s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1529570984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de9390d8-005d-4f67-8ab4-f161fd5d49ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:16Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Creating volume de9390d8-005d-4f67-8ab4-f161fd5d49ca {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:30 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:30 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b" returned: 0 in 0.838s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:30 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca 1073741824 Jul 10 07:02:30 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f69284f-0d99-4795-81c5-2bafa03bcc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7189d7f3-b729-4df5-b12a-2963fb229687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:30 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b Jul 10 07:02:30 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:30 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb (f2570f7a-67ed-4923-9a09-bd6b5b7de8cb): created successfully Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7189d7f3-b729-4df5-b12a-2963fb229687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (0b052c4e-1a5b-4cb6-8611-bf09818103c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-23209855-68a3-4a12-be39-362a46412d40 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created volume successfully. Jul 10 07:02:30 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba" returned: 0 in 0.807s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:30 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba Jul 10 07:02:30 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:30 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d784571f-0221-46fe-b330-76bbe527d03b" returned: 0 in 0.714s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-quobyte-d784571f-0221-46fe-b330-76bbe527d03b" released by "delete_volume" :: held 1.594s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Created reservations ['d2619552-ea11-4cc4-90ed-4288d818efab', '280da919-1e24-48c4-a901-b5bbd8557170', '7c419e0e-ceda-4c11-a5f5-51a6acd64c28', '96e5b8c6-5a13-4267-9aea-cad197a6b21f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:30 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:30 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:31 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca 1073741824" returned: 0 in 0.965s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:31 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca Jul 10 07:02:31 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:31 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba" returned: 1 in 0.830s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Downloaded image 9ceab909-b61a-4365-b7a9-04bab20b8613 ((None, [{'url': 'file:///opt/stack/data/glance/images/9ceab909-b61a-4365-b7a9-04bab20b8613', 'metadata': {}}])) to volume 2642ce65-753e-4f22-b39b-79613b58f3ba successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Temporary image 9ceab909-b61a-4365-b7a9-04bab20b8613 for user 2e54ed0eeccd40e29ae138b33e1e8153 is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Marking volume 2642ce65-753e-4f22-b39b-79613b58f3ba as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Copying metadata from image 9ceab909-b61a-4365-b7a9-04bab20b8613 to 2642ce65-753e-4f22-b39b-79613b58f3ba. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Creating volume glance metadata for volume 2642ce65-753e-4f22-b39b-79613b58f3ba backed by image 9ceab909-b61a-4365-b7a9-04bab20b8613 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9ceab909-b61a-4365-b7a9-04bab20b8613', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1848351427c3d2f32a6721580acd3a7d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2001d55-890c-45d6-b6f9-d4347bd8a9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2642ce65-753e-4f22-b39b-79613b58f3ba', 'volume_size': 1, 'image_id': '9ceab909-b61a-4365-b7a9-04bab20b8613', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ceab909-b61a-4365-b7a9-04bab20b8613', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1848351427c3d2f32a6721580acd3a7d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4661c0d771a248cdb9b3b04834212b37', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c12a2f5fb5393839d554753b1fc323207f7f3b1b11fb54f3b13f644503bf26f5cf3547ef0b10cc6883e1e7348e4155ef8493d932e33290204fc69e697c7ee36', 'id': '9ceab909-b61a-4365-b7a9-04bab20b8613', 'created_at': datetime.datetime(2026, 7, 10, 5, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ceab909-b61a-4365-b7a9-04bab20b8613/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b4cdb1-a40b-43ec-ae1b-e00b324c0999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:31 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Volume volume-2642ce65-753e-4f22-b39b-79613b58f3ba (2642ce65-753e-4f22-b39b-79613b58f3ba): created successfully Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b4cdb1-a40b-43ec-ae1b-e00b324c0999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Flow 'volume_create_manager' (80615973-5e61-4d79-928e-8016c4066708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bdb98b0d-2864-496a-b20f-4275f031836c tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Created volume successfully. Jul 10 07:02:31 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.741s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Deleted volume successfully. Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef8a94d0-870e-45fe-9edc-bb314145c8c7 tempest-CreateVolumesFromImageTest-1415349977 None] Lock "cinder-d784571f-0221-46fe-b330-76bbe527d03b-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:31 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca" returned: 0 in 0.757s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.166s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410304862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814dbd07-d06f-4a01-b246-a831cf681c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a642b0f098a840f7a74d0cb11e59d605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:17Z,use_quota=True,user_id='14e8e022c90649e98a42e961eb3dc4f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Creating volume 814dbd07-d06f-4a01-b246-a831cf681c62 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:31 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:31 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62 1073741824 Jul 10 07:02:31 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8880d16-99da-4d57-9448-b16320e267a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b945a4e-8a17-4154-b445-1c50a1c9532b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:31 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca (de9390d8-005d-4f67-8ab4-f161fd5d49ca): created successfully Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b945a4e-8a17-4154-b445-1c50a1c9532b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (3582cdb9-e0ea-48f2-bac4-7bc74312858c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:31 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d545910c-53b0-4025-9660-7160e74aee9d tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created volume successfully. Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Acquiring lock "cinder-2642ce65-753e-4f22-b39b-79613b58f3ba-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Lock "cinder-2642ce65-753e-4f22-b39b-79613b58f3ba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Acquiring lock "cinder-quobyte-2642ce65-753e-4f22-b39b-79613b58f3ba" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Lock "cinder-quobyte-2642ce65-753e-4f22-b39b-79613b58f3ba" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:32 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1b0f25-8f58-4c45-bbbb-2bd2c3ec5163]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:32 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba Jul 10 07:02:32 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:32 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62 1073741824" returned: 0 in 0.924s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:32 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62 Jul 10 07:02:32 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:33 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba" returned: 0 in 0.927s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:33 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba Jul 10 07:02:33 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:33 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62" returned: 0 in 0.789s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.387s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879464825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ea3ea8-aed1-4ed5-928c-24e182757252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:24Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Creating volume 83ea3ea8-aed1-4ed5-928c-24e182757252 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:33 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:33 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252 1073741824 Jul 10 07:02:33 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be96669-836d-44f6-83e1-4c361891e4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814dbd07-d06f-4a01-b246-a831cf681c62', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbf6aa4-a52d-4cf3-8b20-144bdc1c66aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Volume volume-814dbd07-d06f-4a01-b246-a831cf681c62 (814dbd07-d06f-4a01-b246-a831cf681c62): created successfully Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbf6aa4-a52d-4cf3-8b20-144bdc1c66aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Flow 'volume_create_manager' (53c42429-51d1-4775-8b93-3497223de99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-200705d6-7b5e-409f-8d0b-e9116f9f3f89 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created volume successfully. Jul 10 07:02:33 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba" returned: 1 in 0.815s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:02:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:33 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba Jul 10 07:02:33 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-814dbd07-d06f-4a01-b246-a831cf681c62-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-814dbd07-d06f-4a01-b246-a831cf681c62-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-quobyte-814dbd07-d06f-4a01-b246-a831cf681c62" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-814dbd07-d06f-4a01-b246-a831cf681c62" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99617bd-1435-4635-9994-e7fe876bbbfa]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:34 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62 Jul 10 07:02:34 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:34 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252 1073741824" returned: 0 in 1.009s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:34 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2642ce65-753e-4f22-b39b-79613b58f3ba" returned: 0 in 0.850s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:34 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252 Jul 10 07:02:34 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Lock "cinder-quobyte-2642ce65-753e-4f22-b39b-79613b58f3ba" released by "delete_volume" :: held 2.683s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Created reservations ['13267bd2-25c4-4b15-a114-5eb9d0b01a50', 'b35db3e5-3ac9-488d-9e19-504c0d7600c0', 'b7fee6e1-e535-4400-a5ba-c74efdd6c2a6', '67cda644-6314-479d-9959-17e93e850dcf'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:34 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:34 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:35 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62" returned: 0 in 0.916s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:35 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62 Jul 10 07:02:35 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:35 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252" returned: 0 in 0.852s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.908s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032781421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2d571e-469b-459c-a8fb-7ff984a7c468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:24Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Creating volume 8a2d571e-469b-459c-a8fb-7ff984a7c468 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:35 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:35 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468 1073741824 Jul 10 07:02:35 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455e580d-f196-46f3-a3bd-a0a9674657b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ea3ea8-aed1-4ed5-928c-24e182757252', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a10050-dab7-41ca-b692-5061dd35b8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume volume-83ea3ea8-aed1-4ed5-928c-24e182757252 (83ea3ea8-aed1-4ed5-928c-24e182757252): created successfully Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a10050-dab7-41ca-b692-5061dd35b8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (10939f58-0384-4d1e-9d2e-b35e2c711c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8702d774-d781-4f33-9c9c-7e8ea082bc88 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created volume successfully. Jul 10 07:02:35 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.891s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Deleted volume successfully. Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5ab7a534-d355-4147-8602-85bd185598f8 tempest-VolumeAndVolumeTypeFromImageTest-457638294 None] Lock "cinder-2642ce65-753e-4f22-b39b-79613b58f3ba-delete_volume" released by "delete_volume" :: held 3.829s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:35 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-814dbd07-d06f-4a01-b246-a831cf681c62" returned: 0 in 0.793s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:35 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-814dbd07-d06f-4a01-b246-a831cf681c62" released by "delete_volume" :: held 1.768s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created reservations ['8edd2566-b684-4309-80e2-827c68b6bdcf', 'bd7b29b6-5c79-4205-9dcc-e7f853abea23', '6daafdb2-a6c5-4664-a0b2-0b7666c564bf', 'bcd08e6e-8ef6-4b53-903c-a6db22b3dbbf'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:36 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:36 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-de9390d8-005d-4f67-8ab4-f161fd5d49ca-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-de9390d8-005d-4f67-8ab4-f161fd5d49ca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-quobyte-de9390d8-005d-4f67-8ab4-f161fd5d49ca" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-de9390d8-005d-4f67-8ab4-f161fd5d49ca" acquired by "delete_volume" :: waited 0.038s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bddcec4-4098-4276-9ebb-98498e430e0f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:36 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468 1073741824" returned: 0 in 1.168s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:36 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468 Jul 10 07:02:36 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:36 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca Jul 10 07:02:36 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:37 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.993s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Deleted volume successfully. Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80310a92-993e-4dc3-a8df-b49e15d18659 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-814dbd07-d06f-4a01-b246-a831cf681c62-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:37 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca" returned: 0 in 0.879s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:37 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca Jul 10 07:02:37 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:37 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468" returned: 0 in 0.894s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.545s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635685308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b8629e-9928-4011-9239-c23084b643dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:25Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Creating volume 05b8629e-9928-4011-9239-c23084b643dc {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:37 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:37 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc 1073741824 Jul 10 07:02:37 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11915435-ddf4-43d5-9627-9e42e3e9e6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2d571e-469b-459c-a8fb-7ff984a7c468', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee10bfd-e1a8-4c95-b915-e738bfb20b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:37 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume volume-8a2d571e-469b-459c-a8fb-7ff984a7c468 (8a2d571e-469b-459c-a8fb-7ff984a7c468): created successfully Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee10bfd-e1a8-4c95-b915-e738bfb20b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (baa3d031-1ad8-480a-a6cc-119e654a1195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:37 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d7e64d04-b9ce-4ac7-8d93-1e282abd1026 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created volume successfully. Jul 10 07:02:38 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-de9390d8-005d-4f67-8ab4-f161fd5d49ca" returned: 0 in 0.886s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-de9390d8-005d-4f67-8ab4-f161fd5d49ca" released by "delete_volume" :: held 1.869s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created reservations ['d2cfc2d4-7b72-48db-812b-ff56da4b28ad', 'b3c9467d-13b4-4378-b080-0b1f2f33e9ab', '8d0d51f3-3b4e-438e-85e2-303506835c85', 'ffcf5779-cbb7-4370-9314-011241b2eee4'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:38 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:38 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:38 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc 1073741824" returned: 0 in 1.046s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:38 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc Jul 10 07:02:38 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-quobyte-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9835efca-9e39-4679-90f9-17e40ff1426f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:39 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb Jul 10 07:02:39 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:39 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.020s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Deleted volume successfully. Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-dc348b63-23d0-463e-9fe5-98cb3c909720 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-de9390d8-005d-4f67-8ab4-f161fd5d49ca-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:39 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc" returned: 0 in 0.928s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.124s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1562799589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497bdf98-641c-4d47-8ec9-4858df49c4c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:25Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Creating volume 497bdf98-641c-4d47-8ec9-4858df49c4c7 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:39 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:39 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7 1073741824 Jul 10 07:02:39 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48669f6b-47bb-45be-8ff6-4a61d1f67add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b8629e-9928-4011-9239-c23084b643dc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d912a618-2dfb-4fd9-9add-3ae93e42395c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:39 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume volume-05b8629e-9928-4011-9239-c23084b643dc (05b8629e-9928-4011-9239-c23084b643dc): created successfully Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d912a618-2dfb-4fd9-9add-3ae93e42395c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (47980015-be6c-4a75-8081-9b9ae1114351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f33aef71-9fc6-4a5c-a837-6cc25273c7fc tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created volume successfully. Jul 10 07:02:40 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb" returned: 0 in 1.212s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:40 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb Jul 10 07:02:40 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:40 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7 1073741824" returned: 0 in 0.987s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:40 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7 Jul 10 07:02:40 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:40 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb" returned: 0 in 0.811s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb" released by "delete_volume" :: held 2.091s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created reservations ['588a32d4-a7be-4773-aa38-4831b9ebc56b', 'e5909e4d-6eb0-4b09-b718-abb12dada156', '2a18a4b8-5efe-4460-a4df-0597648c96df', '50de126a-e167-4431-97f3-6c6ad590f830'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:41 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:41 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:41 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7" returned: 0 in 0.765s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.440s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918178981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4d96c0-0465-4717-8fe4-26a52adb87a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c337c66593447b8c91b75fd94827f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:26Z,use_quota=True,user_id='96d947d047434be6b8170921a09fafc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Creating volume 7d4d96c0-0465-4717-8fe4-26a52adb87a7 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:41 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:41 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7 1073741824 Jul 10 07:02:41 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fe089c-f97c-435f-a34e-df4dfb75cb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497bdf98-641c-4d47-8ec9-4858df49c4c7', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2400cddb-8ea8-48b8-9f0c-55ab1ae678f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:41 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume volume-497bdf98-641c-4d47-8ec9-4858df49c4c7 (497bdf98-641c-4d47-8ec9-4858df49c4c7): created successfully Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2400cddb-8ea8-48b8-9f0c-55ab1ae678f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (c2bfd5ce-31db-484e-b90a-1aadc261134b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:41 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-390567cc-b457-46d5-bd16-4c5253d83ab7 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created volume successfully. Jul 10 07:02:42 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.990s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Deleted volume successfully. Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d697f82-6cd9-4ab8-84c7-e74edb57e6f6 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-f2570f7a-67ed-4923-9a09-bd6b5b7de8cb-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-ff5f4194-8ed1-497c-9286-94c051167f2c-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-ff5f4194-8ed1-497c-9286-94c051167f2c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-quobyte-ff5f4194-8ed1-497c-9286-94c051167f2c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Flow 'volume_create_manager' (d6dc265f-f3be-4a12-9903-c1e99efdfc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e510d2-3b9a-47da-8358-a969aa7daa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-ff5f4194-8ed1-497c-9286-94c051167f2c" acquired by "delete_volume" :: waited 0.071s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e510d2-3b9a-47da-8358-a969aa7daa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1003252065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802f8d67-1bd4-4d97-9126-49e93b49d9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28741b94f3ce4823bfe8acdd56f2e0e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:42Z,use_quota=True,user_id='f4a98c944a524064b12ae1b501b9b79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660297f7-78db-4e36-916d-cbb4ba28894b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660297f7-78db-4e36-916d-cbb4ba28894b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c7b5e1-853d-4eae-94cc-4456b1d63e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c7b5e1-853d-4eae-94cc-4456b1d63e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802f8d67-1bd4-4d97-9126-49e93b49d9b4', 'volume_name': 'volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620ee94a-cb12-467c-80dd-3d9bee58c0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620ee94a-cb12-467c-80dd-3d9bee58c0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f77e4b8-3e75-4119-8328-5a4cfb0e972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Volume 802f8d67-1bd4-4d97-9126-49e93b49d9b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4', 'volume_size': 1} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[52304f61-bc02-49ee-8ff9-6d29d032dac5]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:42 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7 1073741824" returned: 0 in 1.003s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:42 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c Jul 10 07:02:42 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:42 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7 Jul 10 07:02:42 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:43 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c" returned: 0 in 0.787s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:43 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7" returned: 0 in 0.680s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.816s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1003252065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802f8d67-1bd4-4d97-9126-49e93b49d9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28741b94f3ce4823bfe8acdd56f2e0e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:42Z,use_quota=True,user_id='f4a98c944a524064b12ae1b501b9b79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Creating volume 802f8d67-1bd4-4d97-9126-49e93b49d9b4 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:43 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c Jul 10 07:02:43 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:43 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b8a2df-f9e4-472a-83a9-7113749f23b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61eaf12-c630-49b7-b533-3f43b5c70196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:43 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 1073741824 Jul 10 07:02:43 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Volume volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7 (7d4d96c0-0465-4717-8fe4-26a52adb87a7): created successfully Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61eaf12-c630-49b7-b533-3f43b5c70196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Flow 'volume_create_manager' (8a7d7348-6bbf-4b0b-895c-9745800c82fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7d9d819a-3088-4f3f-86ba-7ca896bf1bce tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created volume successfully. Jul 10 07:02:44 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-ff5f4194-8ed1-497c-9286-94c051167f2c" returned: 0 in 0.784s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-ff5f4194-8ed1-497c-9286-94c051167f2c" released by "delete_volume" :: held 1.663s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created reservations ['6a60706e-ff02-4a64-95a3-9230238fb9e0', '701a395a-b6c6-43ca-8e79-02a6516afa6e', 'b493b5d0-8370-46d8-81a8-035dc8ae8818', '97d027d0-e622-4452-8513-5c2a926213ed'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-7d4d96c0-0465-4717-8fe4-26a52adb87a7-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:44 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:44 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-7d4d96c0-0465-4717-8fe4-26a52adb87a7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-quobyte-7d4d96c0-0465-4717-8fe4-26a52adb87a7" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-7d4d96c0-0465-4717-8fe4-26a52adb87a7" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:44 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 1073741824" returned: 0 in 1.055s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b65b9b-c1cc-4d47-a381-94b775adaef3]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:44 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 Jul 10 07:02:44 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:44 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7 Jul 10 07:02:44 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-34e40604-107a-443f-acd8-4e2e1c4ca95c-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-34e40604-107a-443f-acd8-4e2e1c4ca95c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-quobyte-34e40604-107a-443f-acd8-4e2e1c4ca95c" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-34e40604-107a-443f-acd8-4e2e1c4ca95c" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[33324683-fc3c-465c-9fca-c37d527d4695]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:44 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c Jul 10 07:02:44 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:45 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.831s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Deleted volume successfully. Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ad0f229f-2524-42e8-ae95-5c71fe0a3acf tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-ff5f4194-8ed1-497c-9286-94c051167f2c-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:45 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4" returned: 0 in 0.847s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:45 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7" returned: 0 in 0.897s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f77e4b8-3e75-4119-8328-5a4cfb0e972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a0c97f-af8c-4da8-93df-65d52027c8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:45 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7 Jul 10 07:02:45 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Volume volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 (802f8d67-1bd4-4d97-9126-49e93b49d9b4): created successfully Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a0c97f-af8c-4da8-93df-65d52027c8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Flow 'volume_create_manager' (d6dc265f-f3be-4a12-9903-c1e99efdfc41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-049a69ab-3abd-4b35-8ae3-7aad23ec880d tempest-VolumeDependencyTests-247744946 None] Created volume successfully. Jul 10 07:02:45 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c" returned: 0 in 0.877s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:45 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c Jul 10 07:02:45 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:45 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7d4d96c0-0465-4717-8fe4-26a52adb87a7" returned: 0 in 0.717s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-7d4d96c0-0465-4717-8fe4-26a52adb87a7" released by "delete_volume" :: held 1.674s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created reservations ['c87eb18e-0b0b-4839-8700-011c09a6a433', 'd12ebccb-ce4b-4ff6-99a9-2b51359fe97a', 'c4f7248d-8ce8-43b5-acf2-6793a507a626', 'c05d49b3-9270-48b8-8697-8257db45591a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:46 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:46 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:46 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-34e40604-107a-443f-acd8-4e2e1c4ca95c" returned: 0 in 0.682s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-34e40604-107a-443f-acd8-4e2e1c4ca95c" released by "delete_volume" :: held 1.611s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created reservations ['6e948551-c258-441d-93fe-d01539f982f3', '6c577753-f247-4d85-bd54-0660993dcf87', '37d37797-4902-49ba-9e87-869201806faa', 'bceb996a-aa1d-4539-9cad-1093a7bd107f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:46 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:46 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-497bdf98-641c-4d47-8ec9-4858df49c4c7-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-497bdf98-641c-4d47-8ec9-4858df49c4c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-quobyte-497bdf98-641c-4d47-8ec9-4858df49c4c7" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-497bdf98-641c-4d47-8ec9-4858df49c4c7" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d877865-d94a-4b74-8c71-d2dece7b08f2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] Creating offline snapshot 3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 of volume 802f8d67-1bd4-4d97-9126-49e93b49d9b4 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1147cd-f41a-4cc6-8dd6-1f01a2d083ef]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:46 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7 Jul 10 07:02:46 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:46 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-d322d586-72dd-41f1-a5e4-126894336103-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:46 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-d322d586-72dd-41f1-a5e4-126894336103-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:47 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.912s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "cinder-quobyte-d322d586-72dd-41f1-a5e4-126894336103" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Deleted volume successfully. Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-d322d586-72dd-41f1-a5e4-126894336103" acquired by "delete_volume" :: waited 0.027s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-97e33963-5cce-44d1-b0cf-4b586c332216 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-7d4d96c0-0465-4717-8fe4-26a52adb87a7-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c720f011-6b16-40ee-9a79-2825e9d5736f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:47 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103 Jul 10 07:02:47 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:47 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.063s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Deleted volume successfully. Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-898f00d3-127e-4b8b-ac93-86800aefc377 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-34e40604-107a-443f-acd8-4e2e1c4ca95c-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:47 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4" returned: 0 in 1.012s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:47 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 1G Jul 10 07:02:47 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:48 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7" returned: 0 in 1.318s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:48 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7 Jul 10 07:02:48 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:48 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103" returned: 0 in 0.970s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:48 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103 Jul 10 07:02:48 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:48 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 1G" returned: 0 in 0.973s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:48 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 Jul 10 07:02:48 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:48 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:48 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-497bdf98-641c-4d47-8ec9-4858df49c4c7" returned: 0 in 0.931s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d322d586-72dd-41f1-a5e4-126894336103" returned: 0 in 0.843s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-497bdf98-641c-4d47-8ec9-4858df49c4c7" released by "delete_volume" :: held 2.323s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:48 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-quobyte-d322d586-72dd-41f1-a5e4-126894336103" released by "delete_volume" :: held 1.882s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created reservations ['07347715-2f35-4583-9c10-f5ebaf5e9d40', '1bff7a6f-34a5-4b6a-8c73-50862365b077', 'f13e4be2-edfa-422a-bf1a-1d561e908d66', '254030ad-72d4-4c33-8abf-a537e10a2310'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Created reservations ['64cba998-0ba9-40ba-94a7-5c4299f69646', '0e5e6103-e022-48e2-aa60-e52ca8ee33ad', '219546ca-3746-48c5-a57f-cd25a2c71d0e', 'e5a7c51d-a265-408a-9836-44cd787eec27'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:49 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:49 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:49 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:49 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:49 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86" returned: 0 in 0.996s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:49 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 is being set with open permissions: ugo+rw Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:49 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 Jul 10 07:02:49 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-05b8629e-9928-4011-9239-c23084b643dc-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-05b8629e-9928-4011-9239-c23084b643dc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:50 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.822s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Deleted volume successfully. Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-quobyte-05b8629e-9928-4011-9239-c23084b643dc" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-0823ca5b-1bf7-437f-8ecf-adaedb5fdab9 tempest-CreateVolumesFromSourceVolumeTest-60538129 None] Lock "cinder-d322d586-72dd-41f1-a5e4-126894336103-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-05b8629e-9928-4011-9239-c23084b643dc" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba008f35-e89d-4ea8-b407-e72b2f89a2b5]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:50 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:50 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc Jul 10 07:02:50 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.168s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:50 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Deleted volume successfully. Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5593cf26-678f-43cb-a055-c847e502e74c tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-497bdf98-641c-4d47-8ec9-4858df49c4c7-delete_volume" released by "delete_volume" :: held 3.810s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:50 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86" returned: 0 in 0.972s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:50 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.info Jul 10 07:02:50 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:51 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc" returned: 0 in 1.038s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:51 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc Jul 10 07:02:51 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:51 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.info" returned: 0 in 0.861s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:51 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.info is being set with open permissions: ugo+rw Jul 10 07:02:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:51 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.info Jul 10 07:02:51 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:51 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-05b8629e-9928-4011-9239-c23084b643dc" returned: 0 in 0.757s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-05b8629e-9928-4011-9239-c23084b643dc" released by "delete_volume" :: held 1.852s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created reservations ['4b7c69d2-5d6d-434e-a7e5-a0f396418142', '232e0bdb-91ae-4e3f-92f4-039207188883', '0d9ef950-f6fa-48bb-878f-c226599a85c6', '7402cde0-859e-4699-8713-fdba52b42d20'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:52 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:52 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-8a2d571e-469b-459c-a8fb-7ff984a7c468-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-8a2d571e-469b-459c-a8fb-7ff984a7c468-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-quobyte-8a2d571e-469b-459c-a8fb-7ff984a7c468" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-8a2d571e-469b-459c-a8fb-7ff984a7c468" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:52 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.info" returned: 0 in 0.884s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.846s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[879d1432-55a7-4d9e-9b3d-db7b65c6048b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-10f07ad6-1132-4353-a2b7-0ea93ff4e43b tempest-VolumeDependencyTests-247744946 None] Create snapshot completed successfully Jul 10 07:02:52 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468 Jul 10 07:02:52 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:52 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.811s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:52 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Deleted volume successfully. Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-96d3ad48-1213-4e81-82f7-922f66635d2a tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-05b8629e-9928-4011-9239-c23084b643dc-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:53 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468" returned: 0 in 1.042s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:53 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468 Jul 10 07:02:53 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Flow 'volume_create_manager' (736c0d2a-4a6b-49ee-bfc0-e6133f2cf1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6237a4-88b0-4aab-bcee-6c6a7933dda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6237a4-88b0-4aab-bcee-6c6a7933dda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-261610320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4481246e-c5b5-4375-9499-56e07732cf1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28741b94f3ce4823bfe8acdd56f2e0e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:02:54Z,use_quota=True,user_id='f4a98c944a524064b12ae1b501b9b79a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124c6a6f-9feb-47c8-9600-2228bda91e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124c6a6f-9feb-47c8-9600-2228bda91e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4033a30-fee2-4f58-8cb2-f3dfb8012c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4033a30-fee2-4f58-8cb2-f3dfb8012c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4481246e-c5b5-4375-9499-56e07732cf1d', 'volume_name': 'volume-4481246e-c5b5-4375-9499-56e07732cf1d', 'volume_size': 1, 'snapshot_id': '3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50aa84c-750c-4738-b41e-b8c6de33ad78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50aa84c-750c-4738-b41e-b8c6de33ad78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d16fa0-5095-4218-8ccf-f03b16f1143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:02:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Volume 4481246e-c5b5-4375-9499-56e07732cf1d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4481246e-c5b5-4375-9499-56e07732cf1d', 'volume_size': 1, 'snapshot_id': '3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86'} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "cinder-quobyte-3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86-4481246e-c5b5-4375-9499-56e07732cf1d" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86-4481246e-c5b5-4375-9499-56e07732cf1d" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Creating volume 4481246e-c5b5-4375-9499-56e07732cf1d from snapshot 3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "cinder-quobyte-4481246e-c5b5-4375-9499-56e07732cf1d" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-4481246e-c5b5-4375-9499-56e07732cf1d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] snapshot: 3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86, volume: 4481246e-c5b5-4375-9499-56e07732cf1d, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8debf2cc-d11c-48e7-b869-ce686421b205]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:54 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 Jul 10 07:02:54 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:54 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8a2d571e-469b-459c-a8fb-7ff984a7c468" returned: 0 in 0.779s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-8a2d571e-469b-459c-a8fb-7ff984a7c468" released by "delete_volume" :: held 1.920s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created reservations ['3c10e950-3cb2-43a1-826b-2b01e2794ec2', '1d6de19a-4fa7-4308-9007-83144ccfe179', '6cea0c42-5a39-4358-8aa1-791d8abdcd0b', 'a668e604-fb19-407e-b5f1-a23b355a6036'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:54 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:54 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-83ea3ea8-aed1-4ed5-928c-24e182757252-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-83ea3ea8-aed1-4ed5-928c-24e182757252-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-quobyte-83ea3ea8-aed1-4ed5-928c-24e182757252" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-83ea3ea8-aed1-4ed5-928c-24e182757252" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e82ee21-c31b-4d4c-a161-0f26705630b9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:54 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86" returned: 0 in 1.037s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6675d53-d812-4571-8386-2abae4ccf3b6]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:55 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252 Jul 10 07:02:55 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:55 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 Jul 10 07:02:55 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:55 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.968s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:55 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:55 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Deleted volume successfully. Jul 10 07:02:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-28802c61-6b61-43b7-9dc8-a66c7acdc6f2 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-8a2d571e-469b-459c-a8fb-7ff984a7c468-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:55 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4" returned: 0 in 0.995s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:55 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:02:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:55 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252" returned: 0 in 1.078s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:55 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d Jul 10 07:02:55 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:56 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252 Jul 10 07:02:56 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:56 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83ea3ea8-aed1-4ed5-928c-24e182757252" returned: 0 in 0.715s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-83ea3ea8-aed1-4ed5-928c-24e182757252" released by "delete_volume" :: held 1.843s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:56 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=147,cinder:UPDATE=179,cinder:INSERT=42,cinder:DELETE=14 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:02:56 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created reservations ['7ca0fab0-de5a-4b33-b369-aee9da3cdf44', 'dad7ac3b-d0dc-4b50-802b-77f3db33e6ec', '27745800-6624-413a-9aa3-316cf02fccbc', 'a5cfbb44-8591-4e72-b937-d812faa5abdd'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:56 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:02:56 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-e8eb2e97-fe38-40d1-81fe-a63842bd5983-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-e8eb2e97-fe38-40d1-81fe-a63842bd5983-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-quobyte-60f3faff-bcd4-4eab-9fab-29782d0afdd2" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-60f3faff-bcd4-4eab-9fab-29782d0afdd2" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-quobyte-e8eb2e97-fe38-40d1-81fe-a63842bd5983" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:02:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-e8eb2e97-fe38-40d1-81fe-a63842bd5983" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:02:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Deleting offline snapshot e8eb2e97-fe38-40d1-81fe-a63842bd5983 of volume 60f3faff-bcd4-4eab-9fab-29782d0afdd2 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:02:57 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] snapshot_file for this snap is: volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:02:57 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbf07e4-0d59-48a3-92ce-07101dca93f1]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:58 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 Jul 10 07:02:58 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:59 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 2.281s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:59 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Deleted volume successfully. Jul 10 07:02:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-8c716fc3-6f6d-4779-b148-4a9849921b37 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-83ea3ea8-aed1-4ed5-928c-24e182757252-delete_volume" released by "delete_volume" :: held 4.434s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:59 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983" returned: 0 in 2.287s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:02:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d2172-9f65-4e20-8c91-c0fd02c1bc8d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:02:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:00 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 Jul 10 07:03:00 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:01 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2" returned: 0 in 1.665s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:01 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 Jul 10 07:03:01 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:02 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d" returned: 0 in 6.427s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:02 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f3f11e-da94-4962-8098-a540c8efe005]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:02 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 Jul 10 07:03:02 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:02 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983" returned: 0 in 1.107s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:02 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983 Jul 10 07:03:02 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:03 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4" returned: 0 in 1.186s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:03 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:03:03 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Converted 1024.00 MB image at 159.24 MB/s Jul 10 07:03:03 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d is being set with open permissions: ugo+rw Jul 10 07:03:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:03 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2.e8eb2e97-fe38-40d1-81fe-a63842bd5983" returned: 0 in 0.867s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:03 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=129,cinder:UPDATE=212,cinder:INSERT=56,cinder:DELETE=23 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:03:03 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d Jul 10 07:03:03 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-e8eb2e97-fe38-40d1-81fe-a63842bd5983" released by "_delete_snapshot" :: held 6.227s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-60f3faff-bcd4-4eab-9fab-29782d0afdd2" released by "delete_snapshot" :: held 6.287s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:03 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created reservations ['9b2b8158-dfba-4e5e-9740-ae0f12b382c1', '4beb5851-5d0c-424e-9574-fcd93f5db0c9', '257aa989-7f1f-4ea2-9221-ad6aaebeed56', '1154d7ce-57b6-4229-b556-33519438d5ff'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Delete snapshot completed successfully. Jul 10 07:03:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-784ad19c-44d0-4a24-9c8f-312eeba93b39 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-e8eb2e97-fe38-40d1-81fe-a63842bd5983-delete_snapshot" released by "delete_snapshot" :: held 6.513s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-60f3faff-bcd4-4eab-9fab-29782d0afdd2-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-60f3faff-bcd4-4eab-9fab-29782d0afdd2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "cinder-quobyte-60f3faff-bcd4-4eab-9fab-29782d0afdd2" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-60f3faff-bcd4-4eab-9fab-29782d0afdd2" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8122e3-3e94-41e9-9441-ebd374e70f80]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:04 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 Jul 10 07:03:04 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:04 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d" returned: 0 in 0.929s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-4481246e-c5b5-4375-9499-56e07732cf1d" released by "_copy_volume_from_snapshot" :: held 10.693s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86-4481246e-c5b5-4375-9499-56e07732cf1d" released by "_create_volume_from_snapshot" :: held 10.733s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.750s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d16fa0-5095-4218-8ccf-f03b16f1143a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4481246e-c5b5-4375-9499-56e07732cf1d', 'volume_size': 1, 'snapshot_id': '3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e95583e-d915-42e0-ac5f-756c02c6bfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:04 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Volume volume-4481246e-c5b5-4375-9499-56e07732cf1d (4481246e-c5b5-4375-9499-56e07732cf1d): created successfully Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e95583e-d915-42e0-ac5f-756c02c6bfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Flow 'volume_create_manager' (736c0d2a-4a6b-49ee-bfc0-e6133f2cf1e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-24c5cbe6-d301-402f-886b-d86ed0dcccb4 tempest-VolumeDependencyTests-247744946 None] Created volume successfully. Jul 10 07:03:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "cinder-3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "cinder-quobyte-802f8d67-1bd4-4d97-9126-49e93b49d9b4" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-802f8d67-1bd4-4d97-9126-49e93b49d9b4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "cinder-quobyte-3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:05 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Deleting offline snapshot 3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 of volume 802f8d67-1bd4-4d97-9126-49e93b49d9b4 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] snapshot_file for this snap is: volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2" returned: 0 in 0.992s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d714e44-9e36-43bb-8398-cfa246a5d100]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:05 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2 Jul 10 07:03:05 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Flow 'volume_create_manager' (f90df87b-c665-4168-8d84-2d581b5f437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0865139-7610-42ea-803e-48167e41184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0865139-7610-42ea-803e-48167e41184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615435744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8baad8f-64ea-4d50-8144-9a075491bd4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbc7fc750c774527a40ef76789773c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:05Z,use_quota=True,user_id='fcac0402b2614cd0a7fc8d41f3d20f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147db6d4-e5d6-4384-8827-7c9b5033634b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147db6d4-e5d6-4384-8827-7c9b5033634b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcdabd4-d7a5-40cc-aec5-8deb6cb62933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcdabd4-d7a5-40cc-aec5-8deb6cb62933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8baad8f-64ea-4d50-8144-9a075491bd4f', 'volume_name': 'volume-d8baad8f-64ea-4d50-8144-9a075491bd4f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3595bc-eaf0-43a0-b1a9-bf05a61bc74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3595bc-eaf0-43a0-b1a9-bf05a61bc74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f52645-fac5-4038-8551-aad7ca7ce86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:05 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Volume d8baad8f-64ea-4d50-8144-9a075491bd4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8baad8f-64ea-4d50-8144-9a075491bd4f', 'volume_size': 1} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615435744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8baad8f-64ea-4d50-8144-9a075491bd4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbc7fc750c774527a40ef76789773c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:05Z,use_quota=True,user_id='fcac0402b2614cd0a7fc8d41f3d20f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Creating volume d8baad8f-64ea-4d50-8144-9a075491bd4f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:05 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:03:05 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 Jul 10 07:03:05 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:05 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f 1073741824 Jul 10 07:03:05 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:05 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-60f3faff-bcd4-4eab-9fab-29782d0afdd2" returned: 0 in 0.677s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-quobyte-60f3faff-bcd4-4eab-9fab-29782d0afdd2" released by "delete_volume" :: held 1.744s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Created reservations ['cf3dec4c-e547-42b4-b40d-d41c38f3c462', 'dde461ca-ffd9-4c3c-a52c-4df709c8de62', '203a9a86-121d-4da8-8528-124b68542bae', '5504bc7c-8ebd-4153-b0ac-da0f950a328b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:05 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:03:05 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:06 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86" returned: 0 in 0.891s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:03:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a23c802-6c2e-4daa-840c-ca6933d40170]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:06 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 Jul 10 07:03:06 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:06 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f 1073741824" returned: 0 in 1.107s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:06 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f Jul 10 07:03:06 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:06 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.813s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:06 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:03:06 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Deleted volume successfully. Jul 10 07:03:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-b4b0af27-0158-4e81-92dd-c359c3b67ce3 tempest-CreateVolumesFromSnapshotTest-1477352368 None] Lock "cinder-60f3faff-bcd4-4eab-9fab-29782d0afdd2-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:07 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4" returned: 0 in 1.163s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:07 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 Jul 10 07:03:07 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:07 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f" returned: 0 in 0.895s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:03:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f52645-fac5-4038-8551-aad7ca7ce86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8baad8f-64ea-4d50-8144-9a075491bd4f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5968eedc-57d1-436f-8027-2d97480181e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Volume volume-d8baad8f-64ea-4d50-8144-9a075491bd4f (d8baad8f-64ea-4d50-8144-9a075491bd4f): created successfully Jul 10 07:03:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5968eedc-57d1-436f-8027-2d97480181e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Flow 'volume_create_manager' (f90df87b-c665-4168-8d84-2d581b5f437f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a7859a23-1334-4ab4-9531-3b204d2c0499 tempest-ProjectReaderTests-668987241 None] Created volume successfully. Jul 10 07:03:08 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86" returned: 0 in 0.927s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:08 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86 Jul 10 07:03:08 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Acquiring lock "cinder-d8baad8f-64ea-4d50-8144-9a075491bd4f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Lock "cinder-d8baad8f-64ea-4d50-8144-9a075491bd4f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Acquiring lock "cinder-quobyte-d8baad8f-64ea-4d50-8144-9a075491bd4f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Lock "cinder-quobyte-d8baad8f-64ea-4d50-8144-9a075491bd4f" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:08 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c4a422-bd62-49c3-a4c3-f63b3f8c9496]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:08 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f Jul 10 07:03:08 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:09 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4.3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86" returned: 0 in 0.891s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86" released by "_delete_snapshot" :: held 4.008s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-802f8d67-1bd4-4d97-9126-49e93b49d9b4" released by "delete_snapshot" :: held 4.062s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:09 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Created reservations ['b641f458-200c-4060-b10d-71884b686bdb', 'c1d56bae-4cc6-48a9-a1b9-51c388140b9d', 'e8ded44c-2553-4d5f-99d0-e3338bbaaedf', '2761553c-a357-4a97-a302-7f596a044a2d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Delete snapshot completed successfully. Jul 10 07:03:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9fc7173b-90c0-4b76-b22f-32a83098c6e7 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-3bd3a66d-ea1e-4490-86c3-9bdd1d7e1f86-delete_snapshot" released by "delete_snapshot" :: held 4.288s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:09 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f" returned: 0 in 0.894s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:09 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f Jul 10 07:03:09 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "cinder-802f8d67-1bd4-4d97-9126-49e93b49d9b4-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-802f8d67-1bd4-4d97-9126-49e93b49d9b4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "cinder-quobyte-802f8d67-1bd4-4d97-9126-49e93b49d9b4" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-802f8d67-1bd4-4d97-9126-49e93b49d9b4" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:10 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d8baad8f-64ea-4d50-8144-9a075491bd4f" returned: 0 in 0.843s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Lock "cinder-quobyte-d8baad8f-64ea-4d50-8144-9a075491bd4f" released by "delete_volume" :: held 1.795s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f77f41-1243-426d-b9f0-701b6065606d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Created reservations ['31291df1-6aa8-49d8-9426-3cbbf01baf10', '86211085-0588-4574-b44a-7a0f0e277b48', 'a4dc2b10-d4c9-4b47-9eb0-a97d209cc040', '0853aaa7-dd53-4fd0-b8bd-44b5761bff6a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:10 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 Jul 10 07:03:10 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:10 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:03:10 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:11 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4" returned: 0 in 1.167s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:11 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:03:11 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:11 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4 Jul 10 07:03:11 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Flow 'volume_create_manager' (3bd6d1a8-d3d1-4845-a480-13b1819c6b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27bcb83-f12e-4b57-aec7-7d87db07b634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e27bcb83-f12e-4b57-aec7-7d87db07b634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763954044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753ec800-46fc-43aa-9d98-715af730a9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbc7fc750c774527a40ef76789773c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:12Z,use_quota=True,user_id='fcac0402b2614cd0a7fc8d41f3d20f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96108ec-a9a2-4ef2-9ecb-68945b59e14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96108ec-a9a2-4ef2-9ecb-68945b59e14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a4db48-3424-4454-a481-118c8b9b42b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a4db48-3424-4454-a481-118c8b9b42b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753ec800-46fc-43aa-9d98-715af730a9bc', 'volume_name': 'volume-753ec800-46fc-43aa-9d98-715af730a9bc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844f8cc1-c7cd-4b49-b21f-87cecf1a2f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (844f8cc1-c7cd-4b49-b21f-87cecf1a2f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:11 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3f06ff-8d03-4a83-92a8-af6c04223111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Volume 753ec800-46fc-43aa-9d98-715af730a9bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753ec800-46fc-43aa-9d98-715af730a9bc', 'volume_size': 1} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763954044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753ec800-46fc-43aa-9d98-715af730a9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbc7fc750c774527a40ef76789773c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:12Z,use_quota=True,user_id='fcac0402b2614cd0a7fc8d41f3d20f4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Creating volume 753ec800-46fc-43aa-9d98-715af730a9bc {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:11 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.244s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:03:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Deleted volume successfully. Jul 10 07:03:11 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc 1073741824 Jul 10 07:03:11 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3ab62185-a5d3-436b-af1d-1c24c7b7a980 tempest-ProjectReaderTests-668987241 None] Lock "cinder-d8baad8f-64ea-4d50-8144-9a075491bd4f-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:12 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.869s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:03:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:03:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:03:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:03:12 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-802f8d67-1bd4-4d97-9126-49e93b49d9b4" returned: 0 in 1.195s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-802f8d67-1bd4-4d97-9126-49e93b49d9b4" released by "delete_volume" :: held 2.449s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:12 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Created reservations ['814a135d-aa97-446a-89ad-f6b0978a3b73', 'c9ea34d5-9c29-426a-a495-47dabaeea883', '85cbcdd5-34aa-4775-8e63-8d6b3f179f84', '72dcd0b6-56e0-44fb-806f-0214f6af8204'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:13 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:03:13 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:13 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc 1073741824" returned: 0 in 1.284s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:13 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc Jul 10 07:03:13 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Flow 'volume_create_manager' (04302492-859c-4d22-b404-61b6a07712f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2e5108-9ca0-4cc1-99ed-8d7773b617be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2e5108-9ca0-4cc1-99ed-8d7773b617be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d734da66-11ad-4c0f-9c42-135caaa998ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5732efa36d54f6b8230f96af65aba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:14Z,use_quota=True,user_id='3d53b69498a2466e8d9bb064f2ffea9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853270bd-8199-4c00-a5ae-0fa0ac838ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853270bd-8199-4c00-a5ae-0fa0ac838ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfe6a53-974c-4fe9-9730-dd25c06d6a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.image.glance [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Creating Keystone auth plugin from conf {{(pid=86966) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "cinder-4481246e-c5b5-4375-9499-56e07732cf1d-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-4481246e-c5b5-4375-9499-56e07732cf1d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "cinder-quobyte-4481246e-c5b5-4375-9499-56e07732cf1d" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-4481246e-c5b5-4375-9499-56e07732cf1d" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:14 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.965s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dd3edc-ad8b-412e-aa7a-9025fa3aee03]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Deleted volume successfully. Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-72b5c653-a6e2-485a-8f64-5dcb71087766 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-802f8d67-1bd4-4d97-9126-49e93b49d9b4-delete_volume" released by "delete_volume" :: held 3.758s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:14 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d Jul 10 07:03:14 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfe6a53-974c-4fe9-9730-dd25c06d6a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd734da66-11ad-4c0f-9c42-135caaa998ec', 'volume_name': 'volume-d734da66-11ad-4c0f-9c42-135caaa998ec', 'volume_size': 1, 'image_id': 'ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fff5afc5bed169a49f1bffed24c3e8d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a5732efa36d54f6b8230f96af65aba5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbcedf7f466feae04fc3dc64530ed69da50c9d2fb8eb74edeb0b5caa9051ddf3e104a285aa78129f32684ddccc854e42fe937965e3e2a1a43e38750c61004d07', 'id': 'ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'created_at': datetime.datetime(2026, 7, 10, 5, 3, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddcd2f38-fa19-4f2d-88e3-9779239ab0e3/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e146c07d-70f7-40a0-a7aa-031137151fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e146c07d-70f7-40a0-a7aa-031137151fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3ffc1c-440f-4edd-a373-ecbdbf0aea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Volume d734da66-11ad-4c0f-9c42-135caaa998ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d734da66-11ad-4c0f-9c42-135caaa998ec', 'volume_size': 1, 'image_id': 'ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fff5afc5bed169a49f1bffed24c3e8d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a5732efa36d54f6b8230f96af65aba5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbcedf7f466feae04fc3dc64530ed69da50c9d2fb8eb74edeb0b5caa9051ddf3e104a285aa78129f32684ddccc854e42fe937965e3e2a1a43e38750c61004d07', 'id': 'ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'created_at': datetime.datetime(2026, 7, 10, 5, 3, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddcd2f38-fa19-4f2d-88e3-9779239ab0e3/file', 'properties': {}}, 'image_service': } Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Trying to clone d734da66-11ad-4c0f-9c42-135caaa998ec from image ddcd2f38-fa19-4f2d-88e3-9779239ab0e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'metadata': {}}]). {{(pid=86966) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 07:03:14 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:14 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Image download 0.00 MB at 0.00 MB/s Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc" returned: 0 in 1.152s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] <== create_volume: return (2491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.494s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3f06ff-8d03-4a83-92a8-af6c04223111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753ec800-46fc-43aa-9d98-715af730a9bc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd80942-e79a-485f-9e26-ef9ed6b5e8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e18c15-49a3-4ebb-bc5a-349049747638]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Volume volume-753ec800-46fc-43aa-9d98-715af730a9bc (753ec800-46fc-43aa-9d98-715af730a9bc): created successfully Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fd80942-e79a-485f-9e26-ef9ed6b5e8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Flow 'volume_create_manager' (3bd6d1a8-d3d1-4845-a480-13b1819c6b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-823289cd-06b9-4723-bf08-742733f00b3a tempest-ProjectReaderTests-668987241 None] Created volume successfully. Jul 10 07:03:14 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD Jul 10 07:03:14 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Acquiring lock "cinder-753ec800-46fc-43aa-9d98-715af730a9bc-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Lock "cinder-753ec800-46fc-43aa-9d98-715af730a9bc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Acquiring lock "cinder-quobyte-753ec800-46fc-43aa-9d98-715af730a9bc" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Lock "cinder-quobyte-753ec800-46fc-43aa-9d98-715af730a9bc" acquired by "delete_volume" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb3c139-d6f9-4d42-bc96-e2c269f9d007]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:15 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d" returned: 0 in 1.043s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:15 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d Jul 10 07:03:15 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:15 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc Jul 10 07:03:15 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:15 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD" returned: 0 in 0.917s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:15 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD Jul 10 07:03:15 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:15 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-4481246e-c5b5-4375-9499-56e07732cf1d" returned: 0 in 0.814s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-quobyte-4481246e-c5b5-4375-9499-56e07732cf1d" released by "delete_volume" :: held 1.943s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:15 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Created reservations ['43ee7edd-7a3e-4d22-869c-a935e2f53480', '7af12d1e-81ea-4668-b9f6-f957fda7bd8c', '584b1c44-c225-41bf-8b79-ff75f6069b6f', 'dc36aa62-2bd7-479c-a61d-74a69a0e05db'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:16 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc" returned: 0 in 1.024s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:16 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc Jul 10 07:03:16 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:03:16 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:16 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:16 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD" returned: 1 in 1.003s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Temporary image ddcd2f38-fa19-4f2d-88e3-9779239ab0e3 is fetched for user 3d53b69498a2466e8d9bb064f2ffea9e. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[488d67cc-acd8-4f15-adb4-e1541afd79f6]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:16 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD Jul 10 07:03:16 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:17 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-753ec800-46fc-43aa-9d98-715af730a9bc" returned: 0 in 0.972s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Lock "cinder-quobyte-753ec800-46fc-43aa-9d98-715af730a9bc" released by "delete_volume" :: held 2.073s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:17 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 1.020s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:03:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Deleted volume successfully. Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d739bb70-0ac2-45db-99a9-2e53c49b4254 tempest-VolumeDependencyTests-247744946 None] Lock "cinder-4481246e-c5b5-4375-9499-56e07732cf1d-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Created reservations ['a4d128af-d30b-42e7-a6a3-c7eea44c9566', '4a9da7d4-2327-4642-a5d5-eec718ae7fa6', 'f5d09ae8-e567-438e-a058-b6cfda2fea91', 'ed47eb72-4559-4435-8b6e-6c4f7b2ee140'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:17 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:03:17 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:17 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD" returned: 0 in 1.001s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:17 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD Jul 10 07:03:17 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:18 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.813s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:03:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Deleted volume successfully. Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7621c1a0-3a1e-47b7-871a-13d42118654c tempest-ProjectReaderTests-668987241 None] Lock "cinder-753ec800-46fc-43aa-9d98-715af730a9bc-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:18 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD" returned: 1 in 1.034s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d734da66-11ad-4c0f-9c42-135caaa998ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5732efa36d54f6b8230f96af65aba5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:14Z,use_quota=True,user_id='3d53b69498a2466e8d9bb064f2ffea9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Creating volume d734da66-11ad-4c0f-9c42-135caaa998ec {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:18 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:03:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:18 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec 1073741824 Jul 10 07:03:18 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:19 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec 1073741824" returned: 0 in 1.105s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:19 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec Jul 10 07:03:19 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:20 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec" returned: 0 in 0.789s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:03:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:20 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Attempting download of ddcd2f38-fa19-4f2d-88e3-9779239ab0e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'metadata': {}}])) to volume d734da66-11ad-4c0f-9c42-135caaa998ec. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 07:03:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c5f5b2-7056-4546-81d3-6470f4e6e467]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_6ndbdipf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:20 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_6ndbdipf Jul 10 07:03:20 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:21 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_6ndbdipf" returned: 0 in 0.908s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_6ndbdipf {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:21 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_6ndbdipf Jul 10 07:03:21 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:22 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_6ndbdipf" returned: 1 in 0.871s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_6ndbdipf' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:03:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[be94964a-4632-4c26-bf97-1f269cf12183]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:22 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD Jul 10 07:03:22 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:23 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD" returned: 0 in 0.881s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:23 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD Jul 10 07:03:23 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:24 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD" returned: 1 in 1.215s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:03:24 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] ddcd2f38-fa19-4f2d-88e3-9779239ab0e3 was raw, converting to raw {{(pid=86966) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 07:03:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:24 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec Jul 10 07:03:24 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:25 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec" returned: 0 in 1.022s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:25 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ddcd2f38-fa19-4f2d-88e3-9779239ab0e3_9cy4unk1devstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:03:25 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 07:03:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:25 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec 1G Jul 10 07:03:25 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:26 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec 1G" returned: 0 in 1.023s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[969ed70b-46f0-4339-a5b0-7223967b0203]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:26 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec Jul 10 07:03:26 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:27 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec" returned: 0 in 0.961s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:27 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec Jul 10 07:03:27 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:28 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec" returned: 1 in 1.138s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Downloaded image ddcd2f38-fa19-4f2d-88e3-9779239ab0e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'metadata': {}}])) to volume d734da66-11ad-4c0f-9c42-135caaa998ec successfully. {{(pid=86966) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 07:03:28 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Temporary image ddcd2f38-fa19-4f2d-88e3-9779239ab0e3 for user 3d53b69498a2466e8d9bb064f2ffea9e is deleted. {{(pid=86966) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 07:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.volume_utils [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Marking volume d734da66-11ad-4c0f-9c42-135caaa998ec as bootable. {{(pid=86966) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 07:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Copying metadata from image ddcd2f38-fa19-4f2d-88e3-9779239ab0e3 to d734da66-11ad-4c0f-9c42-135caaa998ec. {{(pid=86966) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 07:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Creating volume glance metadata for volume d734da66-11ad-4c0f-9c42-135caaa998ec backed by image ddcd2f38-fa19-4f2d-88e3-9779239ab0e3 with: {'image_id': 'ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fff5afc5bed169a49f1bffed24c3e8d3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86966) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 07:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3ffc1c-440f-4edd-a373-ecbdbf0aea6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d734da66-11ad-4c0f-9c42-135caaa998ec', 'volume_size': 1, 'image_id': 'ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fff5afc5bed169a49f1bffed24c3e8d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a5732efa36d54f6b8230f96af65aba5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fbcedf7f466feae04fc3dc64530ed69da50c9d2fb8eb74edeb0b5caa9051ddf3e104a285aa78129f32684ddccc854e42fe937965e3e2a1a43e38750c61004d07', 'id': 'ddcd2f38-fa19-4f2d-88e3-9779239ab0e3', 'created_at': datetime.datetime(2026, 7, 10, 5, 3, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 5, 3, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ddcd2f38-fa19-4f2d-88e3-9779239ab0e3/file', 'properties': {}}, 'image_service': }' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e05d10-29c8-4daf-80cb-9b6fc7e0e0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Volume volume-d734da66-11ad-4c0f-9c42-135caaa998ec (d734da66-11ad-4c0f-9c42-135caaa998ec): created successfully Jul 10 07:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e05d10-29c8-4daf-80cb-9b6fc7e0e0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Flow 'volume_create_manager' (04302492-859c-4d22-b404-61b6a07712f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-136042bb-1a96-4803-a192-41e38bab80c0 tempest-VolumeImageDependencyTests-927530252 None] Created volume successfully. Jul 10 07:03:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Acquiring lock "cinder-d734da66-11ad-4c0f-9c42-135caaa998ec-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Lock "cinder-d734da66-11ad-4c0f-9c42-135caaa998ec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Acquiring lock "cinder-quobyte-d734da66-11ad-4c0f-9c42-135caaa998ec" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:29 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Lock "cinder-quobyte-d734da66-11ad-4c0f-9c42-135caaa998ec" acquired by "delete_volume" :: waited 0.029s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:29 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dbc110-45ba-4be1-9f23-5f6bf9c5b6e6]: (4, 'raw') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:29 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec Jul 10 07:03:29 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (79b893c2-0cc6-44f0-98a4-58653fdb13ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34d6fb4-3b7e-4339-b30e-acb61ce0b469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34d6fb4-3b7e-4339-b30e-acb61ce0b469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-85208648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67eae5f9-9547-481c-b287-de708b2dff6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:30Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51640112-6bbc-4b22-b37e-3f1ed56fde66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51640112-6bbc-4b22-b37e-3f1ed56fde66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d4b6c6-bb67-4fb4-b01c-e850b4b766b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d4b6c6-bb67-4fb4-b01c-e850b4b766b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67eae5f9-9547-481c-b287-de708b2dff6e', 'volume_name': 'volume-67eae5f9-9547-481c-b287-de708b2dff6e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea43dd5-1b43-43bd-9873-38b30eb623b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea43dd5-1b43-43bd-9873-38b30eb623b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bb6023-3261-4eaa-a290-0ab2a88bf754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:30 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Volume 67eae5f9-9547-481c-b287-de708b2dff6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67eae5f9-9547-481c-b287-de708b2dff6e', 'volume_size': 1} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-85208648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67eae5f9-9547-481c-b287-de708b2dff6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:30Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Creating volume 67eae5f9-9547-481c-b287-de708b2dff6e {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:30 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:30 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e 1073741824 Jul 10 07:03:30 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:30 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec" returned: 0 in 1.155s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:30 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec Jul 10 07:03:30 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:31 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e 1073741824" returned: 0 in 1.219s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:31 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e Jul 10 07:03:31 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:31 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec" returned: 1 in 1.132s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec' failed. Not Retrying. {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 07:03:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:31 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec Jul 10 07:03:31 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:32 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e" returned: 0 in 0.821s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.100s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bb6023-3261-4eaa-a290-0ab2a88bf754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67eae5f9-9547-481c-b287-de708b2dff6e', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5983d9-ccc8-460b-ba00-0ec33ea2619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:32 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Volume volume-67eae5f9-9547-481c-b287-de708b2dff6e (67eae5f9-9547-481c-b287-de708b2dff6e): created successfully Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5983d9-ccc8-460b-ba00-0ec33ea2619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (79b893c2-0cc6-44f0-98a4-58653fdb13ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f89463b9-2c83-46fa-bab3-f02e59590804 tempest-ProjectMemberTests-1413003193 None] Created volume successfully. Jul 10 07:03:32 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d734da66-11ad-4c0f-9c42-135caaa998ec" returned: 0 in 0.831s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Flow 'volume_create_manager' (24e76f1d-40be-488a-9e6d-5f4b97fdadc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596b519f-09bc-4794-8d84-9fef0d07c7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Lock "cinder-quobyte-d734da66-11ad-4c0f-9c42-135caaa998ec" released by "delete_volume" :: held 3.269s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596b519f-09bc-4794-8d84-9fef0d07c7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493589107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3531d99-7d81-4e49-be9e-8e47b7d4f263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5dd1bea4ae466786b43db4d5384901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:32Z,use_quota=True,user_id='5d93865c850c49d3b26c61746fc623c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c34155-37e9-4ca4-8971-ef44e69a8ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c34155-37e9-4ca4-8971-ef44e69a8ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af535b02-b541-4952-ae64-71655b01d7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af535b02-b541-4952-ae64-71655b01d7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3531d99-7d81-4e49-be9e-8e47b7d4f263', 'volume_name': 'volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d75c05-df71-46bf-9969-2bfc580b436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98d75c05-df71-46bf-9969-2bfc580b436c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c511d7-ac9d-430d-a06e-314905163318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:32 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Volume f3531d99-7d81-4e49-be9e-8e47b7d4f263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263', 'volume_size': 1} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493589107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3531d99-7d81-4e49-be9e-8e47b7d4f263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5dd1bea4ae466786b43db4d5384901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:32Z,use_quota=True,user_id='5d93865c850c49d3b26c61746fc623c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Creating volume f3531d99-7d81-4e49-be9e-8e47b7d4f263 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:32 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:32 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263 1073741824 Jul 10 07:03:32 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Created reservations ['f63b9571-07f6-4cba-897d-7e892bf3c7cb', 'ea845f27-d6b2-4e78-9225-f36f787a6a06', 'f80e8d7d-b512-4592-a2f5-03849cc9b314', 'cc5f684e-9f90-43d8-b533-f3a8048df9ee'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:32 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:03:32 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:33 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.751s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:33 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:03:33 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Deleted volume successfully. Jul 10 07:03:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263 1073741824" returned: 0 in 0.935s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0028e27-3a6c-4e95-bc5f-f19ed791e617 tempest-VolumeImageDependencyTests-927530252 None] Lock "cinder-d734da66-11ad-4c0f-9c42-135caaa998ec-delete_volume" released by "delete_volume" :: held 4.423s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:33 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263 Jul 10 07:03:33 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:34 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263" returned: 0 in 0.775s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:03:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.620s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c511d7-ac9d-430d-a06e-314905163318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182ee63e-05fe-4379-9a83-9861828d1cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] Creating offline snapshot e882190f-a4c2-4488-9925-ee19ea174004 of volume 67eae5f9-9547-481c-b287-de708b2dff6e {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:03:34 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Volume volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263 (f3531d99-7d81-4e49-be9e-8e47b7d4f263): created successfully Jul 10 07:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182ee63e-05fe-4379-9a83-9861828d1cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:34 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Flow 'volume_create_manager' (24e76f1d-40be-488a-9e6d-5f4b97fdadc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d018a0-0809-40f0-a38b-fef3a74f6be4]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:34 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bfb16925-4df0-414f-9104-c36c98506dd5 tempest-ProjectReaderTests-66966874 None] Created volume successfully. Jul 10 07:03:34 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e Jul 10 07:03:34 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:35 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e" returned: 0 in 1.024s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:35 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 1G Jul 10 07:03:35 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Acquiring lock "cinder-f3531d99-7d81-4e49-be9e-8e47b7d4f263-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Lock "cinder-f3531d99-7d81-4e49-be9e-8e47b7d4f263-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Acquiring lock "cinder-quobyte-f3531d99-7d81-4e49-be9e-8e47b7d4f263" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Lock "cinder-quobyte-f3531d99-7d81-4e49-be9e-8e47b7d4f263" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[469da209-2cda-4be3-a44a-d18ed9e39b19]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:36 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263 Jul 10 07:03:36 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:36 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 1G" returned: 0 in 1.060s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eae5f9-9547-481c-b287-de708b2dff6e -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:36 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eae5f9-9547-481c-b287-de708b2dff6e -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 Jul 10 07:03:36 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:37 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263" returned: 0 in 0.919s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:37 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263 Jul 10 07:03:37 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:37 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67eae5f9-9547-481c-b287-de708b2dff6e -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004" returned: 0 in 0.943s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:37 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 is being set with open permissions: ugo+rw Jul 10 07:03:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:37 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 Jul 10 07:03:37 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:37 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:37 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Flow 'volume_create_manager' (889ffa76-805e-4dfb-8af3-ca158fcff32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:37 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e54d4b4-2388-4df6-b631-7f640204714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f3531d99-7d81-4e49-be9e-8e47b7d4f263" returned: 0 in 0.927s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e54d4b4-2388-4df6-b631-7f640204714d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b950f9f-602c-44da-8c7d-5af88d66a86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0900b1ad0b949c2a2b689e0cf5c3b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:38Z,use_quota=True,user_id='57a8f1426a4c44f2ab56e66771eebccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9f384f-7bfe-474e-961e-a60e85811c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9f384f-7bfe-474e-961e-a60e85811c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dff3757-ce58-4841-8f1d-2a9566612db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dff3757-ce58-4841-8f1d-2a9566612db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b950f9f-602c-44da-8c7d-5af88d66a86f', 'volume_name': 'volume-2b950f9f-602c-44da-8c7d-5af88d66a86f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c881d9b-3e19-4235-b5f2-9d517478e0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c881d9b-3e19-4235-b5f2-9d517478e0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322e4d2d-5c92-4b9c-bf9c-d02839a87648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:38 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Volume 2b950f9f-602c-44da-8c7d-5af88d66a86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b950f9f-602c-44da-8c7d-5af88d66a86f', 'volume_size': 1} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Lock "cinder-quobyte-f3531d99-7d81-4e49-be9e-8e47b7d4f263" released by "delete_volume" :: held 1.943s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Created reservations ['db9b8424-5b06-42ac-94d0-6ede161c7c2e', 'e4bf9724-f5d4-4502-9b51-45c6fdf584f0', '8ab5bc92-2ed3-4490-ac23-58680ec831e3', '38af1fb3-d80d-42a4-9ede-f3aaf8db238e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:38 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:03:38 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:38 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004" returned: 0 in 0.897s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:38 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.info Jul 10 07:03:38 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Flow 'volume_create_manager' (6f46bee7-fa15-43f8-a453-8eca7681fe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b9a819-bf0b-4230-bb38-e01a32b70aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b9a819-bf0b-4230-bb38-e01a32b70aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-180976488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf9c8bb-ce36-43ce-8827-fa1390114a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5dd1bea4ae466786b43db4d5384901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:39Z,use_quota=True,user_id='5d93865c850c49d3b26c61746fc623c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80842e61-d39a-49c0-b0a6-be4122235d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80842e61-d39a-49c0-b0a6-be4122235d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d005502-e4fb-4cb0-8ca2-aea756f602da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d005502-e4fb-4cb0-8ca2-aea756f602da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cf9c8bb-ce36-43ce-8827-fa1390114a00', 'volume_name': 'volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ae1c5b-2319-4f50-b62d-cc990e30ccea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ae1c5b-2319-4f50-b62d-cc990e30ccea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00adc419-475a-4208-8a5e-6795432091fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:38 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Volume 8cf9c8bb-ce36-43ce-8827-fa1390114a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00', 'volume_size': 1} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:38 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.788s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:38 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:03:38 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Deleted volume successfully. Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1fe03649-1fac-440c-96ae-c6e224da3e8d tempest-ProjectReaderTests-66966874 None] Lock "cinder-f3531d99-7d81-4e49-be9e-8e47b7d4f263-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:39 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.info" returned: 0 in 0.798s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:39 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.info is being set with open permissions: ugo+rw Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:39 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.info Jul 10 07:03:39 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:39 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.info" returned: 0 in 0.654s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.507s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.897s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b950f9f-602c-44da-8c7d-5af88d66a86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0900b1ad0b949c2a2b689e0cf5c3b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:38Z,use_quota=True,user_id='57a8f1426a4c44f2ab56e66771eebccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Creating volume 2b950f9f-602c-44da-8c7d-5af88d66a86f {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:39 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:03:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:40 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f 1073741824 Jul 10 07:03:40 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-76c97d37-2b95-4d23-b6df-ba46efa80b75 tempest-ProjectMemberTests-1413003193 None] Create snapshot completed successfully Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-e882190f-a4c2-4488-9925-ee19ea174004-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-e882190f-a4c2-4488-9925-ee19ea174004-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-67eae5f9-9547-481c-b287-de708b2dff6e" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-67eae5f9-9547-481c-b287-de708b2dff6e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-e882190f-a4c2-4488-9925-ee19ea174004" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-e882190f-a4c2-4488-9925-ee19ea174004" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Deleting offline snapshot e882190f-a4c2-4488-9925-ee19ea174004 of volume 67eae5f9-9547-481c-b287-de708b2dff6e {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] snapshot_file for this snap is: volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c7e1f5-20a6-4798-a7ce-7230d4933e2a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:40 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 Jul 10 07:03:40 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:40 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f 1073741824" returned: 0 in 0.957s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:41 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f Jul 10 07:03:41 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:41 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004" returned: 0 in 0.887s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67eae5f9-9547-481c-b287-de708b2dff6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[538929ef-286d-4eae-9a30-53d421652c08]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:41 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e Jul 10 07:03:41 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:41 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f" returned: 0 in 0.926s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.976s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-180976488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf9c8bb-ce36-43ce-8827-fa1390114a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5dd1bea4ae466786b43db4d5384901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:39Z,use_quota=True,user_id='5d93865c850c49d3b26c61746fc623c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Creating volume 8cf9c8bb-ce36-43ce-8827-fa1390114a00 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:41 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322e4d2d-5c92-4b9c-bf9c-d02839a87648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b950f9f-602c-44da-8c7d-5af88d66a86f', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec32caaf-a7f1-48c0-98ec-27d2f797cb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:41 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00 1073741824 Jul 10 07:03:41 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Volume volume-2b950f9f-602c-44da-8c7d-5af88d66a86f (2b950f9f-602c-44da-8c7d-5af88d66a86f): created successfully Jul 10 07:03:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec32caaf-a7f1-48c0-98ec-27d2f797cb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Flow 'volume_create_manager' (889ffa76-805e-4dfb-8af3-ca158fcff32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:42 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-759a6f03-d74c-4315-8266-fe7f644dc395 tempest-CinderUnicodeTest-1080077294 None] Created volume successfully. Jul 10 07:03:42 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e" returned: 0 in 1.025s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:42 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 Jul 10 07:03:42 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:42 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:42 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Flow 'volume_create_manager' (e84c2956-8910-4b31-975a-8ca838f08cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cea51e-daad-44f8-a898-67db74c25899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00 1073741824" returned: 0 in 1.075s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cea51e-daad-44f8-a898-67db74c25899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1260176121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46dea16-36b3-43e1-bcb9-1c95530271e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8f3afde951425fa015455e88c4e13f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:43Z,use_quota=True,user_id='ad32d2aba16445cd805a3b5ca7c3d8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c116bbe-35c7-41e6-8b46-1fb3bfef476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c116bbe-35c7-41e6-8b46-1fb3bfef476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52865e96-ea31-4a5b-bbf9-50658830c41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52865e96-ea31-4a5b-bbf9-50658830c41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd46dea16-36b3-43e1-bcb9-1c95530271e8', 'volume_name': 'volume-d46dea16-36b3-43e1-bcb9-1c95530271e8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae466ec-b6bf-4392-bc59-163965ae0c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae466ec-b6bf-4392-bc59-163965ae0c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9e910c-e2a2-4364-a139-de2346de24fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Volume d46dea16-36b3-43e1-bcb9-1c95530271e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d46dea16-36b3-43e1-bcb9-1c95530271e8', 'volume_size': 1} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Flow 'volume_create_manager' (b1ee6ae3-19b9-4972-b584-2c305cc671b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89613aaa-9d32-4877-94d3-bf096bcbe8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:43 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89613aaa-9d32-4877-94d3-bf096bcbe8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-626914539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c724259f-eef4-42f1-a8de-f4b18b998dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0900b1ad0b949c2a2b689e0cf5c3b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:43Z,use_quota=True,user_id='57a8f1426a4c44f2ab56e66771eebccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a44e71d-d254-4388-bfef-246cc502e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a44e71d-d254-4388-bfef-246cc502e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:43 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00 Jul 10 07:03:43 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0a686d-b5a4-4fb0-bb22-3cb155439147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0a686d-b5a4-4fb0-bb22-3cb155439147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c724259f-eef4-42f1-a8de-f4b18b998dbc', 'volume_name': 'volume-c724259f-eef4-42f1-a8de-f4b18b998dbc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddd6770-2dd0-4f9c-a584-87b7db82da8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddd6770-2dd0-4f9c-a584-87b7db82da8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e4ef08-2d0c-48c6-af3a-7fe5e8d5a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Volume c724259f-eef4-42f1-a8de-f4b18b998dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c724259f-eef4-42f1-a8de-f4b18b998dbc', 'volume_size': 1} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004" returned: 0 in 0.978s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:43 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004 Jul 10 07:03:43 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:43 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00" returned: 0 in 0.673s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1260176121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46dea16-36b3-43e1-bcb9-1c95530271e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8f3afde951425fa015455e88c4e13f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:43Z,use_quota=True,user_id='ad32d2aba16445cd805a3b5ca7c3d8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Creating volume d46dea16-36b3-43e1-bcb9-1c95530271e8 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:43 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00adc419-475a-4208-8a5e-6795432091fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bb91b1-e57e-43d3-af4f-45c0b1c1bc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:43 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:43 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 1073741824 Jul 10 07:03:43 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e.e882190f-a4c2-4488-9925-ee19ea174004" returned: 0 in 0.669s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Volume volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00 (8cf9c8bb-ce36-43ce-8827-fa1390114a00): created successfully Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bb91b1-e57e-43d3-af4f-45c0b1c1bc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Flow 'volume_create_manager' (6f46bee7-fa15-43f8-a453-8eca7681fe7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-e882190f-a4c2-4488-9925-ee19ea174004" released by "_delete_snapshot" :: held 3.694s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b9fb32e3-5d25-4bc9-bbd7-b01668232050 tempest-ProjectReaderTests-66966874 None] Created volume successfully. Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-67eae5f9-9547-481c-b287-de708b2dff6e" released by "delete_snapshot" :: held 3.720s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:43 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Created reservations ['1621f77d-ddb8-4ea0-aa36-71956091a424', '19538be7-67a4-4dab-a21f-40b65a50e9bb', '81b8af05-c8db-4ee9-a422-8744fbd55dbb', '7f890092-272e-4846-928f-698def589f79'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Delete snapshot completed successfully. Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4ac4d70d-8c53-4794-a120-5742a0a03520 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-e882190f-a4c2-4488-9925-ee19ea174004-delete_snapshot" released by "delete_snapshot" :: held 3.889s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Acquiring lock "cinder-8cf9c8bb-ce36-43ce-8827-fa1390114a00-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Lock "cinder-8cf9c8bb-ce36-43ce-8827-fa1390114a00-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Acquiring lock "cinder-quobyte-8cf9c8bb-ce36-43ce-8827-fa1390114a00" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Lock "cinder-quobyte-8cf9c8bb-ce36-43ce-8827-fa1390114a00" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af73f02-d136-40d0-b376-dc4031e03b46]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:44 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00 Jul 10 07:03:44 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:44 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-67eae5f9-9547-481c-b287-de708b2dff6e-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 1073741824" returned: 0 in 0.888s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-67eae5f9-9547-481c-b287-de708b2dff6e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-67eae5f9-9547-481c-b287-de708b2dff6e" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:44 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 Jul 10 07:03:44 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-67eae5f9-9547-481c-b287-de708b2dff6e" acquired by "delete_volume" :: waited 0.024s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[183c8568-3438-4288-81ae-d205f35aab1f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:45 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e Jul 10 07:03:45 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:45 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00" returned: 0 in 0.837s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:45 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00 Jul 10 07:03:45 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:45 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8" returned: 0 in 0.699s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.324s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-626914539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c724259f-eef4-42f1-a8de-f4b18b998dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0900b1ad0b949c2a2b689e0cf5c3b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:43Z,use_quota=True,user_id='57a8f1426a4c44f2ab56e66771eebccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Creating volume c724259f-eef4-42f1-a8de-f4b18b998dbc {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:45 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:45 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc 1073741824 Jul 10 07:03:45 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b9e910c-e2a2-4364-a139-de2346de24fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d46dea16-36b3-43e1-bcb9-1c95530271e8', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd2f92e-a200-468a-b9c4-14df21dc0fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:45 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Volume volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 (d46dea16-36b3-43e1-bcb9-1c95530271e8): created successfully Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd2f92e-a200-468a-b9c4-14df21dc0fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Flow 'volume_create_manager' (e84c2956-8910-4b31-975a-8ca838f08cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-b05ebb6a-7397-4c5b-8e65-74e7bc992c22 tempest-SnapshotDependencyTests-1626125411 None] Created volume successfully. Jul 10 07:03:45 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e" returned: 0 in 0.809s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:45 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e Jul 10 07:03:45 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:45 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-8cf9c8bb-ce36-43ce-8827-fa1390114a00" returned: 0 in 0.654s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Lock "cinder-quobyte-8cf9c8bb-ce36-43ce-8827-fa1390114a00" released by "delete_volume" :: held 1.535s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Created reservations ['e498e08e-0967-43fb-b9fc-dbdc8170f8a3', 'cb7c5424-e129-4076-a1db-646ba9e38f0a', '67285999-33b5-4f8f-8e7b-8e0013f3859c', 'c4340e48-c09a-4096-8480-c63c0acec482'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:46 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:03:46 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:46 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-67eae5f9-9547-481c-b287-de708b2dff6e" returned: 0 in 0.721s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-67eae5f9-9547-481c-b287-de708b2dff6e" released by "delete_volume" :: held 1.599s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Created reservations ['ccdda4ef-4331-490c-badd-cf58d6827d22', '37e681bb-6e80-4309-82dc-2c4ce18a4645', '4d3ba7e8-bd32-4203-af1e-0201367223d3', 'dda9fbb6-705e-43e1-af29-a35b1f201e66'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:46 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc 1073741824" returned: 0 in 0.985s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:46 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc Jul 10 07:03:46 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:46 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:03:46 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:46 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.837s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:03:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Deleted volume successfully. Jul 10 07:03:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5aaf44c4-9f6f-4cd9-ad8c-279e53038cbd tempest-ProjectReaderTests-66966874 None] Lock "cinder-8cf9c8bb-ce36-43ce-8827-fa1390114a00-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Flow 'volume_create_manager' (c7bc32fc-cce0-4ba3-93f7-b3a32f76f1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1094e34e-efd6-4ab7-a2b6-c7bf78cb0eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1094e34e-efd6-4ab7-a2b6-c7bf78cb0eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1569817931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc231178-923a-4b9d-9085-c167bf63d5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5dd1bea4ae466786b43db4d5384901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:47Z,use_quota=True,user_id='5d93865c850c49d3b26c61746fc623c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98635bd-509e-4fb6-af77-66d60797e546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98635bd-509e-4fb6-af77-66d60797e546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019d7899-7b47-4c29-b4c9-43e664d14f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019d7899-7b47-4c29-b4c9-43e664d14f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc231178-923a-4b9d-9085-c167bf63d5a6', 'volume_name': 'volume-bc231178-923a-4b9d-9085-c167bf63d5a6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ba8670-6aa0-4878-8104-618713a1a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ba8670-6aa0-4878-8104-618713a1a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038b374e-f24e-4c48-801a-d310153ed86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Volume bc231178-923a-4b9d-9085-c167bf63d5a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc231178-923a-4b9d-9085-c167bf63d5a6', 'volume_size': 1} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:47 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.803s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:03:47 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc" returned: 0 in 0.858s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Deleted volume successfully. Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.076s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e4ef08-2d0c-48c6-af3a-7fe5e8d5a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c724259f-eef4-42f1-a8de-f4b18b998dbc', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ddbbae-d045-4f89-8ab3-1921ba3def8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] Creating offline snapshot 3ea09d2a-a0d3-48bc-89ca-8a7371b10baa of volume d46dea16-36b3-43e1-bcb9-1c95530271e8 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:03:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Volume volume-c724259f-eef4-42f1-a8de-f4b18b998dbc (c724259f-eef4-42f1-a8de-f4b18b998dbc): created successfully Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ddbbae-d045-4f89-8ab3-1921ba3def8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Flow 'volume_create_manager' (b1ee6ae3-19b9-4972-b584-2c305cc671b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e0097262-75c1-4a4e-b218-ff4c2d12f7f5 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-67eae5f9-9547-481c-b287-de708b2dff6e-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe72c4f2-4fdd-4f04-a35f-b301b63e5fd4]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:47 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d54aca42-3589-440c-a7d8-3c87765206b3 tempest-CinderUnicodeTest-1080077294 None] Created volume successfully. Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (a4a3234a-7e81-4867-99c7-307c8f079873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a2dcf2-0fa9-49e5-b94a-79fff2f68b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82a2dcf2-0fa9-49e5-b94a-79fff2f68b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328066187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0856d8-e971-48b2-9d9d-b31d30719d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:47Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:47 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 Jul 10 07:03:47 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43aa445b-3d7f-4eab-b585-7ed49a7611f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43aa445b-3d7f-4eab-b585-7ed49a7611f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fecf665-f2f4-4255-9761-2745cb103db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fecf665-f2f4-4255-9761-2745cb103db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0856d8-e971-48b2-9d9d-b31d30719d66', 'volume_name': 'volume-5d0856d8-e971-48b2-9d9d-b31d30719d66', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e670e15c-43f9-4fc1-b0b6-2a0c3b67aa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e670e15c-43f9-4fc1-b0b6-2a0c3b67aa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1f5aa6-20dc-4565-ab27-68a0a18c6c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:47 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Volume 5d0856d8-e971-48b2-9d9d-b31d30719d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0856d8-e971-48b2-9d9d-b31d30719d66', 'volume_size': 1} Jul 10 07:03:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:48 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8" returned: 0 in 0.791s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:48 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa 1G Jul 10 07:03:48 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:49 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa 1G" returned: 0 in 0.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:49 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa Jul 10 07:03:49 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:49 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa" returned: 0 in 0.679s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:49 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa is being set with open permissions: ugo+rw Jul 10 07:03:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:49 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa Jul 10 07:03:49 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:50 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa" returned: 0 in 0.631s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:50 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.info Jul 10 07:03:50 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:51 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.info" returned: 0 in 0.629s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:51 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.info is being set with open permissions: ugo+rw Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:51 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.info Jul 10 07:03:51 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:51 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.info" returned: 0 in 0.637s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.255s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.514s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1569817931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc231178-923a-4b9d-9085-c167bf63d5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5dd1bea4ae466786b43db4d5384901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:47Z,use_quota=True,user_id='5d93865c850c49d3b26c61746fc623c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Creating volume bc231178-923a-4b9d-9085-c167bf63d5a6 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:51 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:03:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:51 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6 1073741824 Jul 10 07:03:51 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:51 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d393c831-e5b6-4225-9656-77c24b70e48e tempest-SnapshotDependencyTests-1626125411 None] Create snapshot completed successfully Jul 10 07:03:52 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6 1073741824" returned: 0 in 0.793s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:52 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6 Jul 10 07:03:52 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:53 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Flow 'volume_create_manager' (69fbac02-86d5-4680-9e60-fc39fdf7bb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb809038-aa1f-4530-8b5c-2e6ad7f3f6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6" returned: 0 in 0.684s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.573s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-328066187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0856d8-e971-48b2-9d9d-b31d30719d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:47Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Creating volume 5d0856d8-e971-48b2-9d9d-b31d30719d66 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:53 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb809038-aa1f-4530-8b5c-2e6ad7f3f6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5129dd81-73ad-4bab-8a3f-b99b93ba9a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8f3afde951425fa015455e88c4e13f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ea09d2a-a0d3-48bc-89ca-8a7371b10baa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:53Z,use_quota=True,user_id='ad32d2aba16445cd805a3b5ca7c3d8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:53 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 1073741824 Jul 10 07:03:53 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55a9cf1-65b6-40f8-96d0-81b9b2d9f24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55a9cf1-65b6-40f8-96d0-81b9b2d9f24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (674ca840-e82e-4db4-bbbb-2266e981f031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (674ca840-e82e-4db4-bbbb-2266e981f031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5129dd81-73ad-4bab-8a3f-b99b93ba9a5f', 'volume_name': 'volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f', 'volume_size': 1, 'snapshot_id': '3ea09d2a-a0d3-48bc-89ca-8a7371b10baa'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68686e8f-81b7-412c-90c8-1cce87a3d321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68686e8f-81b7-412c-90c8-1cce87a3d321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5e4010-fe3c-4f46-a42a-b5fba5826c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Volume 5129dd81-73ad-4bab-8a3f-b99b93ba9a5f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f', 'volume_size': 1, 'snapshot_id': '3ea09d2a-a0d3-48bc-89ca-8a7371b10baa'} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038b374e-f24e-4c48-801a-d310153ed86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc231178-923a-4b9d-9085-c167bf63d5a6', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575aa7a4-0f60-4e16-b0e7-32c18b0f022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:53 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Volume volume-bc231178-923a-4b9d-9085-c167bf63d5a6 (bc231178-923a-4b9d-9085-c167bf63d5a6): created successfully Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575aa7a4-0f60-4e16-b0e7-32c18b0f022e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:53 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Flow 'volume_create_manager' (c7bc32fc-cce0-4ba3-93f7-b3a32f76f1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5d977b15-e64b-4991-a4c2-c392f63b8838 tempest-ProjectReaderTests-66966874 None] Created volume successfully. Jul 10 07:03:54 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 1073741824" returned: 0 in 0.822s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:54 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 Jul 10 07:03:54 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Acquiring lock "cinder-bc231178-923a-4b9d-9085-c167bf63d5a6-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Lock "cinder-bc231178-923a-4b9d-9085-c167bf63d5a6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Acquiring lock "cinder-quobyte-bc231178-923a-4b9d-9085-c167bf63d5a6" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Lock "cinder-quobyte-bc231178-923a-4b9d-9085-c167bf63d5a6" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94f830e-7cdb-425b-90b2-ee88563c9666]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:54 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6 Jul 10 07:03:54 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:54 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66" returned: 0 in 0.665s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.340s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1f5aa6-20dc-4565-ab27-68a0a18c6c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0856d8-e971-48b2-9d9d-b31d30719d66', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39083e2d-7e92-455e-8123-db7db3a68e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] Creating offline snapshot 103fab4d-4fc5-47b3-9ffd-a682fc353af9 of volume c724259f-eef4-42f1-a8de-f4b18b998dbc {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:03:54 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Volume volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 (5d0856d8-e971-48b2-9d9d-b31d30719d66): created successfully Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39083e2d-7e92-455e-8123-db7db3a68e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (a4a3234a-7e81-4867-99c7-307c8f079873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa9624f-76a7-4a6d-8cb0-7f49e0dd13fa]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-82106bbf-6050-49a8-83b9-99cc0df3978e tempest-ProjectMemberTests-1413003193 None] Created volume successfully. Jul 10 07:03:54 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc Jul 10 07:03:54 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:55 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:55 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6 Jul 10 07:03:55 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:55 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc" returned: 0 in 0.827s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:55 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 1G Jul 10 07:03:55 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:55 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-bc231178-923a-4b9d-9085-c167bf63d5a6" returned: 0 in 0.678s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:55 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Lock "cinder-quobyte-bc231178-923a-4b9d-9085-c167bf63d5a6" released by "delete_volume" :: held 1.500s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Created reservations ['4d4a81c9-b9d3-40ce-9d4b-3ce10fc742d5', '25ec3b0e-afff-49ae-8f7b-5bd70e921f04', '2628377e-23bb-4002-b111-100ccab394ca', '400df58b-1bdc-423a-b4e9-37164b4b2cd8'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:56 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:03:56 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:56 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 1G" returned: 0 in 0.823s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c724259f-eef4-42f1-a8de-f4b18b998dbc -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:56 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c724259f-eef4-42f1-a8de-f4b18b998dbc -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 Jul 10 07:03:56 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:56 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.669s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:03:56 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Deleted volume successfully. Jul 10 07:03:56 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4f6c28ac-6021-4ae6-8e84-a1c6832e2343 tempest-ProjectReaderTests-66966874 None] Lock "cinder-bc231178-923a-4b9d-9085-c167bf63d5a6-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:INSERT=34,cinder:UPDATE=140,cinder:SELECT=119,cinder:DELETE=12 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Flow 'volume_create_manager' (84ed04b9-b520-4234-909f-7847537772bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2321f009-dfc1-4ee2-b552-1c396cdc1721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2321f009-dfc1-4ee2-b552-1c396cdc1721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97042062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53ad16a-ce4b-4d54-8e2f-e990230082a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5dd1bea4ae466786b43db4d5384901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:57Z,use_quota=True,user_id='5d93865c850c49d3b26c61746fc623c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc506f34-6986-41e0-8eb0-815a3ae539a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc506f34-6986-41e0-8eb0-815a3ae539a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92892ab1-64a6-4cb4-89a7-aa1d86f4018b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92892ab1-64a6-4cb4-89a7-aa1d86f4018b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f53ad16a-ce4b-4d54-8e2f-e990230082a7', 'volume_name': 'volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:57 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1215993e-c222-40f2-99d8-85f9f0a34fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1215993e-c222-40f2-99d8-85f9f0a34fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d1c371-50c2-4c77-abbe-ad55648447d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:03:57 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Volume f53ad16a-ce4b-4d54-8e2f-e990230082a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7', 'volume_size': 1} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c724259f-eef4-42f1-a8de-f4b18b998dbc -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9" returned: 0 in 0.753s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:57 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 is being set with open permissions: ugo+rw Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:57 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 Jul 10 07:03:57 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:57 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9" returned: 0 in 0.627s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:57 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.info Jul 10 07:03:57 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:58 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.info" returned: 0 in 0.637s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:58 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.info is being set with open permissions: ugo+rw Jul 10 07:03:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:58 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.info Jul 10 07:03:58 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:59 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.info" returned: 0 in 0.656s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.450s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.898s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "cinder-quobyte-3ea09d2a-a0d3-48bc-89ca-8a7371b10baa-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" by "_create_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-3ea09d2a-a0d3-48bc-89ca-8a7371b10baa-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Creating volume 5129dd81-73ad-4bab-8a3f-b99b93ba9a5f from snapshot 3ea09d2a-a0d3-48bc-89ca-8a7371b10baa {{(pid=86966) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "cinder-quobyte-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" by "_copy_volume_from_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a846cdb1-1dee-43a2-83d0-a8a934339e00 tempest-CinderUnicodeTest-1080077294 None] Create snapshot completed successfully Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] snapshot: 3ea09d2a-a0d3-48bc-89ca-8a7371b10baa, volume: 5129dd81-73ad-4bab-8a3f-b99b93ba9a5f, {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ba4ce-1773-4ab1-9436-193379295127]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:03:59 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa Jul 10 07:03:59 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "cinder-103fab4d-4fc5-47b3-9ffd-a682fc353af9-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-103fab4d-4fc5-47b3-9ffd-a682fc353af9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "cinder-quobyte-c724259f-eef4-42f1-a8de-f4b18b998dbc" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-quobyte-c724259f-eef4-42f1-a8de-f4b18b998dbc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "cinder-quobyte-103fab4d-4fc5-47b3-9ffd-a682fc353af9" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-quobyte-103fab4d-4fc5-47b3-9ffd-a682fc353af9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Deleting offline snapshot 103fab4d-4fc5-47b3-9ffd-a682fc353af9 of volume c724259f-eef4-42f1-a8de-f4b18b998dbc {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] snapshot_file for this snap is: volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df19da1-15e2-42bd-a22f-ba889fb63d02]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:03:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:00 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 Jul 10 07:04:00 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:00 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa" returned: 0 in 0.798s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46dea16-36b3-43e1-bcb9-1c95530271e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Creating direct copy from snapshot {{(pid=86966) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc6979d-ce04-48d6-9665-20a79626849e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:00 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 Jul 10 07:04:00 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:00 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9" returned: 0 in 0.800s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c724259f-eef4-42f1-a8de-f4b18b998dbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715a362-454c-4a6a-93d8-d02d00bcf950]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:00 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc Jul 10 07:04:00 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:00 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG cinder.utils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Path /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f not found in is_blk_device check {{(pid=86966) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 07:04:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:00 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f Jul 10 07:04:00 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:01 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc" returned: 0 in 0.779s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:01 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 Jul 10 07:04:01 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:02 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9" returned: 0 in 1.282s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:02 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9 Jul 10 07:04:02 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:04 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc.103fab4d-4fc5-47b3-9ffd-a682fc353af9" returned: 0 in 1.409s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:04 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=95,cinder:INSERT=42,cinder:UPDATE=143,cinder:DELETE=13 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:04:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-quobyte-103fab4d-4fc5-47b3-9ffd-a682fc353af9" released by "_delete_snapshot" :: held 4.430s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-quobyte-c724259f-eef4-42f1-a8de-f4b18b998dbc" released by "delete_snapshot" :: held 4.462s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:04 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Created reservations ['2cd08752-810f-4c77-a3c4-6a1dc41f6d1f', '4199c448-d3c1-466f-97d6-ffe74220639d', '47b4208a-8302-4324-89b0-e28964528904', '40680a52-786a-4ff7-89a1-3df229d31ec9'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Delete snapshot completed successfully. Jul 10 07:04:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-5043730d-6cbf-4825-9305-c65ca1de07f0 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-103fab4d-4fc5-47b3-9ffd-a682fc353af9-delete_snapshot" released by "delete_snapshot" :: held 4.746s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "cinder-c724259f-eef4-42f1-a8de-f4b18b998dbc-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-c724259f-eef4-42f1-a8de-f4b18b998dbc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "cinder-quobyte-c724259f-eef4-42f1-a8de-f4b18b998dbc" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-quobyte-c724259f-eef4-42f1-a8de-f4b18b998dbc" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5720c0-2e5a-4fc3-a475-c7fdbf7427bf]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:05 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc Jul 10 07:04:05 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:05 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" returned: 0 in 5.028s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:05 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec128a9-b3c9-40d2-9f6f-77d6276c94f7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:06 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 Jul 10 07:04:06 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:06 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc" returned: 0 in 0.777s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:06 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc Jul 10 07:04:06 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:06 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8" returned: 0 in 0.946s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:06 devstack cinder-volume[86966]: DEBUG cinder.image.image_utils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Image conversion details: src /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f {{(pid=86966) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 07:04:06 devstack cinder-volume[86966]: INFO cinder.image.image_utils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Converted 1024.00 MB image at 203.60 MB/s Jul 10 07:04:06 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f is being set with open permissions: ugo+rw Jul 10 07:04:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:06 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f Jul 10 07:04:06 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:07 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c724259f-eef4-42f1-a8de-f4b18b998dbc" returned: 0 in 0.645s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-quobyte-c724259f-eef4-42f1-a8de-f4b18b998dbc" released by "delete_volume" :: held 1.531s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Created reservations ['4e4aba7a-23f0-486a-9d07-a35a4894c44d', 'ffe58525-1afc-4f0c-a243-96ad57326415', '802d7558-3fe3-4109-962f-e08315bb0951', 'c6a1f7d4-08c4-4f37-91fc-ca73893b7363'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:07 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:04:07 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:07 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" returned: 0 in 0.648s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" released by "_copy_volume_from_snapshot" :: held 8.291s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-3ea09d2a-a0d3-48bc-89ca-8a7371b10baa-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" released by "_create_volume_from_snapshot" :: held 8.325s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.349s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.402s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] Creating offline snapshot 4acf8c33-c1bc-4619-8d08-6ed03c307343 of volume 5d0856d8-e971-48b2-9d9d-b31d30719d66 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5e4010-fe3c-4f46-a42a-b5fba5826c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f', 'volume_size': 1, 'snapshot_id': '3ea09d2a-a0d3-48bc-89ca-8a7371b10baa'}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b37eea-f6e6-4b54-8fc2-6444aed39ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cc90e7-c97b-4804-a06b-96ff08986ede]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:07 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Volume volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f (5129dd81-73ad-4bab-8a3f-b99b93ba9a5f): created successfully Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b37eea-f6e6-4b54-8fc2-6444aed39ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Flow 'volume_create_manager' (69fbac02-86d5-4680-9e60-fc39fdf7bb27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:04:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f20d5e8e-43da-4eb3-a327-0760f2acdc7f tempest-SnapshotDependencyTests-1626125411 None] Created volume successfully. Jul 10 07:04:07 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 Jul 10 07:04:07 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "cinder-2b950f9f-602c-44da-8c7d-5af88d66a86f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-2b950f9f-602c-44da-8c7d-5af88d66a86f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "cinder-quobyte-2b950f9f-602c-44da-8c7d-5af88d66a86f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-quobyte-2b950f9f-602c-44da-8c7d-5af88d66a86f" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39440f4-cee6-4526-9b62-3ee565add0e7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:08 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.681s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:04:08 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Deleted volume successfully. Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1afefbaf-ab56-4b20-a017-826429e19681 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-c724259f-eef4-42f1-a8de-f4b18b998dbc-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:08 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f Jul 10 07:04:08 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "cinder-3ea09d2a-a0d3-48bc-89ca-8a7371b10baa-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-3ea09d2a-a0d3-48bc-89ca-8a7371b10baa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "cinder-quobyte-d46dea16-36b3-43e1-bcb9-1c95530271e8" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-d46dea16-36b3-43e1-bcb9-1c95530271e8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "cinder-quobyte-3ea09d2a-a0d3-48bc-89ca-8a7371b10baa" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-3ea09d2a-a0d3-48bc-89ca-8a7371b10baa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Deleting offline snapshot 3ea09d2a-a0d3-48bc-89ca-8a7371b10baa of volume d46dea16-36b3-43e1-bcb9-1c95530271e8 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] snapshot_file for this snap is: volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f1f24e-bb40-420e-877b-9a9f8fe630a6]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:08 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66" returned: 0 in 0.890s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:08 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 1G Jul 10 07:04:08 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:08 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa Jul 10 07:04:08 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:08 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f" returned: 0 in 0.857s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:08 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f Jul 10 07:04:08 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:09 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa" returned: 0 in 0.815s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46dea16-36b3-43e1-bcb9-1c95530271e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56ee05b-02a4-4b58-9198-3fae38b00f9c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:09 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 1G" returned: 0 in 0.863s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:09 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 Jul 10 07:04:09 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:09 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 Jul 10 07:04:09 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:09 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-2b950f9f-602c-44da-8c7d-5af88d66a86f" returned: 0 in 0.715s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-quobyte-2b950f9f-602c-44da-8c7d-5af88d66a86f" released by "delete_volume" :: held 1.622s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Created reservations ['845d5ea6-0df5-4357-8a55-7b14c1e10adb', 'f668a5e0-2c50-495f-87b7-f88659ae121b', '909eaf97-905c-4c15-a1d1-f4c05399be38', '07706066-775d-45fe-8b63-31e9b578a506'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:09 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:04:09 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:10 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:10 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 is being set with open permissions: ugo+rw Jul 10 07:04:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:10 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8" returned: 0 in 0.884s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:10 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 Jul 10 07:04:10 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:10 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa Jul 10 07:04:10 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:10 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.722s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:10 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:04:10 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Deleted volume successfully. Jul 10 07:04:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-968dc3de-406e-46ae-8a5f-a4ada8601ed0 tempest-CinderUnicodeTest-1080077294 None] Lock "cinder-2b950f9f-602c-44da-8c7d-5af88d66a86f-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:10 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343" returned: 0 in 0.778s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:10 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.info Jul 10 07:04:10 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:11 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa" returned: 0 in 0.897s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:11 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa Jul 10 07:04:11 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:11 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:04:11 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:11 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.info" returned: 0 in 0.708s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:11 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.info is being set with open permissions: ugo+rw Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:11 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.info Jul 10 07:04:11 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:11 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8.3ea09d2a-a0d3-48bc-89ca-8a7371b10baa" returned: 0 in 0.751s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-3ea09d2a-a0d3-48bc-89ca-8a7371b10baa" released by "_delete_snapshot" :: held 3.467s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-d46dea16-36b3-43e1-bcb9-1c95530271e8" released by "delete_snapshot" :: held 3.496s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:11 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Created reservations ['cfc9c30a-b84b-47ae-9461-90c08f996215', '1f6d884a-82af-450b-ae02-cca310e7d681', 'c29f0c24-8bfd-46a1-b554-7f07d8ea1f49', 'af85b1ea-7513-4560-a095-53931c4127da'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:12 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Delete snapshot completed successfully. Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-acd748ed-d5d5-42f8-a199-6e94fa9bbefe tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-3ea09d2a-a0d3-48bc-89ca-8a7371b10baa-delete_snapshot" released by "delete_snapshot" :: held 3.686s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:12 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.760s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:04:12 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.info" returned: 0 in 0.732s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.850s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.180s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97042062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53ad16a-ce4b-4d54-8e2f-e990230082a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab5dd1bea4ae466786b43db4d5384901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:03:57Z,use_quota=True,user_id='5d93865c850c49d3b26c61746fc623c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Creating volume f53ad16a-ce4b-4d54-8e2f-e990230082a7 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:04:12 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:12 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7 1073741824 Jul 10 07:04:12 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:12 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1062537e-fef8-48d5-9291-f0d2dd531aca tempest-ProjectMemberTests-1413003193 None] Create snapshot completed successfully Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "cinder-d46dea16-36b3-43e1-bcb9-1c95530271e8-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-d46dea16-36b3-43e1-bcb9-1c95530271e8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "cinder-quobyte-d46dea16-36b3-43e1-bcb9-1c95530271e8" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-d46dea16-36b3-43e1-bcb9-1c95530271e8" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbecf083-e868-4b23-bc1f-09052611f7d1]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:12 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 Jul 10 07:04:12 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-4acf8c33-c1bc-4619-8d08-6ed03c307343-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Lock "cinder-4acf8c33-c1bc-4619-8d08-6ed03c307343-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-5d0856d8-e971-48b2-9d9d-b31d30719d66" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-5d0856d8-e971-48b2-9d9d-b31d30719d66" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-4acf8c33-c1bc-4619-8d08-6ed03c307343" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-4acf8c33-c1bc-4619-8d08-6ed03c307343" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Deleting offline snapshot 4acf8c33-c1bc-4619-8d08-6ed03c307343 of volume 5d0856d8-e971-48b2-9d9d-b31d30719d66 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] snapshot_file for this snap is: volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d539ab-b71c-45e7-98c2-55f7a617f7d5]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:13 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 Jul 10 07:04:13 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:13 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7 1073741824" returned: 0 in 0.990s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:13 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7 Jul 10 07:04:13 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:13 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8" returned: 0 in 0.902s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:13 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8 Jul 10 07:04:13 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:13 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343" returned: 0 in 0.857s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d0856d8-e971-48b2-9d9d-b31d30719d66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-ed42fbb1-198a-4fc1-8b20-854a356223de tempest-ProjectAdminTests-673949928 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7540664672852, 'free_capacity_gb': 1775.7540664672852, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86966) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[003c455f-96fa-46cc-81a5-a3ef832766d2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:14 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7" returned: 0 in 0.686s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d1c371-50c2-4c77-abbe-ad55648447d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21cb294c-c549-4a2f-982d-421bfa7f4144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:14 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 Jul 10 07:04:14 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:14 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Volume volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7 (f53ad16a-ce4b-4d54-8e2f-e990230082a7): created successfully Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21cb294c-c549-4a2f-982d-421bfa7f4144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Flow 'volume_create_manager' (84ed04b9-b520-4234-909f-7847537772bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:04:14 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-83d404d5-dbff-47b8-9208-dc6001232f50 tempest-ProjectReaderTests-66966874 None] Created volume successfully. Jul 10 07:04:14 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-d46dea16-36b3-43e1-bcb9-1c95530271e8" returned: 0 in 0.710s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-d46dea16-36b3-43e1-bcb9-1c95530271e8" released by "delete_volume" :: held 1.668s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Created reservations ['5516ba31-c557-440e-9ccc-95ccae35655f', '477e4bcc-4f44-446a-8405-8d114a33d17a', '60e0ee42-cfb9-4ae1-8289-17ef802eb845', 'd706f8ad-7d50-4932-8475-22c4379310da'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:14 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:04:14 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Acquiring lock "cinder-f53ad16a-ce4b-4d54-8e2f-e990230082a7-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Lock "cinder-f53ad16a-ce4b-4d54-8e2f-e990230082a7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Acquiring lock "cinder-quobyte-f53ad16a-ce4b-4d54-8e2f-e990230082a7" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Lock "cinder-quobyte-f53ad16a-ce4b-4d54-8e2f-e990230082a7" acquired by "delete_volume" :: waited 0.030s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4556cbf2-2bc4-4bc6-970f-fdc7a23b47c5]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:14 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7 Jul 10 07:04:14 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:14 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66" returned: 0 in 0.893s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "cinder-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:15 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 Jul 10 07:04:15 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "cinder-quobyte-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" acquired by "delete_volume" :: waited 0.047s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee882704-aa4f-4992-9932-ddb0b156618c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:15 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.757s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:04:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Deleted volume successfully. Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b595420-6376-4410-8bfe-393a5b7cf944 tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-d46dea16-36b3-43e1-bcb9-1c95530271e8-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:15 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f Jul 10 07:04:15 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:15 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7" returned: 0 in 0.931s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:15 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7 Jul 10 07:04:15 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:15 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343" returned: 0 in 1.059s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:16 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343 Jul 10 07:04:16 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:16 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" returned: 0 in 0.976s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:16 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f Jul 10 07:04:16 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:16 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-f53ad16a-ce4b-4d54-8e2f-e990230082a7" returned: 0 in 0.785s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Lock "cinder-quobyte-f53ad16a-ce4b-4d54-8e2f-e990230082a7" released by "delete_volume" :: held 1.761s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Created reservations ['b8dc9712-8ce5-44d8-8cb6-5fd64709cb5b', 'd919f15f-3010-42df-9e55-9c3a98e71625', 'b91519d4-9eb0-4396-b3af-288fa59713ad', 'bf4f1975-7c7b-4936-8fb6-f2d9b802efb7'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:16 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:04:16 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:16 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66.4acf8c33-c1bc-4619-8d08-6ed03c307343" returned: 0 in 0.854s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-4acf8c33-c1bc-4619-8d08-6ed03c307343" released by "_delete_snapshot" :: held 3.877s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:16 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-5d0856d8-e971-48b2-9d9d-b31d30719d66" released by "delete_snapshot" :: held 3.913s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" returned: 0 in 0.832s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-quobyte-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f" released by "delete_volume" :: held 1.898s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Created reservations ['13356292-c3f5-4c55-a65e-950305f71dfd', '9eedbaf1-18b3-4c94-a84b-1db4c7b32e7e', '145307f6-7631-456f-9e86-e6cec8a47977', '5f03168e-56b4-4e82-9ed5-251d15be52af'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Created reservations ['f1b10999-b61a-4d0a-adab-b9f7cb79c0c6', '192b8f4c-7017-45c6-8e94-6b11e23d8d65', '626da1d7-0773-4ebe-9889-ede850f91251', 'ddd8c9d3-0384-4f50-b314-54080cc9a62d'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Delete snapshot completed successfully. Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ee180580-2a0a-4259-9017-96de5129fd8b tempest-ProjectMemberTests-1413003193 None] Lock "cinder-4acf8c33-c1bc-4619-8d08-6ed03c307343-delete_snapshot" released by "delete_snapshot" :: held 4.205s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:17 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:04:17 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-5d0856d8-e971-48b2-9d9d-b31d30719d66-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:17 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-5d0856d8-e971-48b2-9d9d-b31d30719d66-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.932s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:04:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Deleted volume successfully. Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-3d1fb131-e841-4c45-a1cc-fef853e1e08c tempest-ProjectReaderTests-66966874 None] Lock "cinder-f53ad16a-ce4b-4d54-8e2f-e990230082a7-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-5d0856d8-e971-48b2-9d9d-b31d30719d66" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-5d0856d8-e971-48b2-9d9d-b31d30719d66" acquired by "delete_volume" :: waited 0.028s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1c56b0-0dcc-42fe-b178-4c85dcc41017]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:17 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 Jul 10 07:04:17 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:18 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.835s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:18 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:04:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Deleted volume successfully. Jul 10 07:04:18 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7b9ce440-3475-48d0-8c7c-d002f3198ea2 tempest-SnapshotDependencyTests-1626125411 None] Lock "cinder-5129dd81-73ad-4bab-8a3f-b99b93ba9a5f-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:18 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66" returned: 0 in 0.942s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:18 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66 Jul 10 07:04:18 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:19 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-5d0856d8-e971-48b2-9d9d-b31d30719d66" returned: 0 in 0.736s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-5d0856d8-e971-48b2-9d9d-b31d30719d66" released by "delete_volume" :: held 1.757s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:19 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Created reservations ['b99ec18d-607c-40bf-a36c-c00d019c6777', 'a9483914-093c-4ed1-b977-8b712e51a961', '8e23de66-27c0-4b0d-93ed-a1d6eb116653', '8d58abeb-895e-4279-8834-dda43af949b7'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:19 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:04:19 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:20 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.814s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:04:20 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Deleted volume successfully. Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6345c103-2c16-407a-be5d-466ae08c6003 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-5d0856d8-e971-48b2-9d9d-b31d30719d66-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (9481c313-3ac6-4d1a-baeb-525dc95f7015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7416d0c2-03ca-41ee-902f-c8fadb8073a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7416d0c2-03ca-41ee-902f-c8fadb8073a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-127123183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc145a8-995d-4d27-ba82-fe0b0b0edeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:04:20Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2774df-6e37-4522-ba8d-80fffadbfb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2774df-6e37-4522-ba8d-80fffadbfb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72737651-aa80-4020-ac39-cb5a75c1f302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72737651-aa80-4020-ac39-cb5a75c1f302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc145a8-995d-4d27-ba82-fe0b0b0edeb2', 'volume_name': 'volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450db764-1be8-47a4-8714-2774f4bfefbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450db764-1be8-47a4-8714-2774f4bfefbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc315cd-69df-4630-bf8a-e4f32633ffe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:20 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Volume fcc145a8-995d-4d27-ba82-fe0b0b0edeb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2', 'volume_size': 1} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-127123183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcc145a8-995d-4d27-ba82-fe0b0b0edeb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:04:20Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Creating volume fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:04:20 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:04:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:20 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 1073741824 Jul 10 07:04:20 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:21 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 1073741824" returned: 0 in 0.919s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:21 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 Jul 10 07:04:21 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:22 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2" returned: 0 in 0.661s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc315cd-69df-4630-bf8a-e4f32633ffe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977dd2cd-843d-4999-a615-eaa3e980da69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:22 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Volume volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 (fcc145a8-995d-4d27-ba82-fe0b0b0edeb2): created successfully Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977dd2cd-843d-4999-a615-eaa3e980da69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (9481c313-3ac6-4d1a-baeb-525dc95f7015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:04:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-bd6bb19f-fbe8-49fd-8ee3-16d370ba5ea4 tempest-ProjectMemberTests-1413003193 None] Created volume successfully. Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] Creating offline snapshot 9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 of volume fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e289ee79-c865-43c0-8a61-264c97ed2a73]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:22 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 Jul 10 07:04:22 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:23 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2" returned: 0 in 0.784s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:23 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 1G Jul 10 07:04:23 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:24 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 1G" returned: 0 in 0.889s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:24 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 Jul 10 07:04:24 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:24 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9" returned: 0 in 0.710s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:24 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 is being set with open permissions: ugo+rw Jul 10 07:04:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:25 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 Jul 10 07:04:25 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:25 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9" returned: 0 in 0.690s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:25 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.info Jul 10 07:04:25 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:26 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.info" returned: 0 in 0.666s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:26 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.info is being set with open permissions: ugo+rw Jul 10 07:04:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:26 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.info Jul 10 07:04:26 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:27 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.info" returned: 0 in 0.637s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.464s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-282dcda5-45d6-44bf-acd3-7eb93b4c6748 tempest-ProjectMemberTests-1413003193 None] Create snapshot completed successfully Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Deleting offline snapshot 9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 of volume fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] snapshot_file for this snap is: volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad1abb6-f303-4300-a68d-3327d3eb48ad]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:27 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 Jul 10 07:04:27 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:28 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9" returned: 0 in 0.747s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:04:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a58813-01eb-4928-b524-71d35051c668]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:28 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 Jul 10 07:04:28 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:29 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2" returned: 0 in 0.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:29 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 Jul 10 07:04:29 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:30 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9" returned: 0 in 0.719s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:30 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9 Jul 10 07:04:30 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:30 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2.9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9" returned: 0 in 0.637s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9" released by "_delete_snapshot" :: held 2.940s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2" released by "delete_snapshot" :: held 2.961s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:30 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Created reservations ['657ce180-7870-4210-bf04-33696ea0874c', '4a9a6d19-e171-4d68-b313-a7d28f974837', '2eac7bac-c8b9-411b-844a-1fa49656b6bb', '33c7391e-472a-4f20-b21b-9f8b46742309'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Delete snapshot completed successfully. Jul 10 07:04:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-9c1bf4f7-e636-46fa-b447-1e35b110c9c8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-9c5e0a89-d8b6-45ca-bc7e-6c23d0cac8c9-delete_snapshot" released by "delete_snapshot" :: held 3.097s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:30 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:31 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2" acquired by "delete_volume" :: waited 0.020s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:31 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cd89c6-13ec-40fe-95dd-039e998a665e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:31 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 Jul 10 07:04:31 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:31 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2" returned: 0 in 0.748s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:31 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2 Jul 10 07:04:31 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:32 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2" returned: 0 in 0.642s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:32 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2" released by "delete_volume" :: held 1.445s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:32 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Created reservations ['62ab23e1-3f08-4a20-824c-28af44d6ce81', '265c64de-3125-464c-8b20-416031ec80c6', '29107389-b8d2-4d93-9fcf-485f7cf8e1b5', 'bcb859ab-0ff6-4d1f-8c0a-1eea3250b180'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:32 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:32 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:04:32 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:33 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.661s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:04:33 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Deleted volume successfully. Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-04912fcd-34ef-4708-9de4-c1bb3ee263e7 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-fcc145a8-995d-4d27-ba82-fe0b0b0edeb2-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (78b9a544-84c4-437c-80d4-b41ac4ebd3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293b3931-27a8-429c-9c8a-00561ff0ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (293b3931-27a8-429c-9c8a-00561ff0ca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521997008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff2462f-f32c-4e79-91a6-fe281eac1da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:04:34Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94adb0da-7ee2-4131-a547-8a32eaeca242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94adb0da-7ee2-4131-a547-8a32eaeca242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf7ca37-518c-4153-a729-ff81cb97902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf7ca37-518c-4153-a729-ff81cb97902d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff2462f-f32c-4e79-91a6-fe281eac1da4', 'volume_name': 'volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d169178c-d256-4dca-90d8-a3afec57778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d169178c-d256-4dca-90d8-a3afec57778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfa79ff-d891-4d68-aec9-131b39bb033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:33 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Volume 7ff2462f-f32c-4e79-91a6-fe281eac1da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4', 'volume_size': 1} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-521997008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff2462f-f32c-4e79-91a6-fe281eac1da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:04:34Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Creating volume 7ff2462f-f32c-4e79-91a6-fe281eac1da4 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:04:33 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:04:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:33 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 1073741824 Jul 10 07:04:33 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:34 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 1073741824" returned: 0 in 0.808s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:34 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 Jul 10 07:04:34 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:35 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4" returned: 0 in 0.632s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfa79ff-d891-4d68-aec9-131b39bb033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a42a30-c296-44b3-9c8b-71894d4d21cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:35 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Volume volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 (7ff2462f-f32c-4e79-91a6-fe281eac1da4): created successfully Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a42a30-c296-44b3-9c8b-71894d4d21cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (78b9a544-84c4-437c-80d4-b41ac4ebd3e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:04:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1073d6b7-949a-4250-92cc-7bc23de00cf8 tempest-ProjectMemberTests-1413003193 None] Created volume successfully. Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] Creating offline snapshot be972557-4ca9-4a0e-a842-5fc4621bd49a of volume 7ff2462f-f32c-4e79-91a6-fe281eac1da4 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d31687-2218-44b3-ba78-8c471406a81d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:35 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 Jul 10 07:04:35 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:36 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4" returned: 0 in 0.762s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:36 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a 1G Jul 10 07:04:36 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:37 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a 1G" returned: 0 in 0.777s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:37 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a Jul 10 07:04:37 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:38 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a" returned: 0 in 0.688s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:38 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a is being set with open permissions: ugo+rw Jul 10 07:04:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:38 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a Jul 10 07:04:38 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:38 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a" returned: 0 in 0.631s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:38 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.info Jul 10 07:04:38 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:39 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.info" returned: 0 in 0.633s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:39 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.info is being set with open permissions: ugo+rw Jul 10 07:04:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:39 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.info Jul 10 07:04:39 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:40 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.info" returned: 0 in 0.630s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.197s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9c073a1c-1f83-483d-a359-604eba3852c3 tempest-ProjectMemberTests-1413003193 None] Create snapshot completed successfully Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-be972557-4ca9-4a0e-a842-5fc4621bd49a-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-be972557-4ca9-4a0e-a842-5fc4621bd49a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-7ff2462f-f32c-4e79-91a6-fe281eac1da4" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-7ff2462f-f32c-4e79-91a6-fe281eac1da4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-be972557-4ca9-4a0e-a842-5fc4621bd49a" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-be972557-4ca9-4a0e-a842-5fc4621bd49a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Deleting offline snapshot be972557-4ca9-4a0e-a842-5fc4621bd49a of volume 7ff2462f-f32c-4e79-91a6-fe281eac1da4 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] snapshot_file for this snap is: volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96e31be-4172-4686-aa5b-964a485e67f4]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:41 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a Jul 10 07:04:41 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:41 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a" returned: 0 in 0.770s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c046e2-a52f-4770-8edd-2463c0349a07]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:42 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 Jul 10 07:04:42 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:42 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4" returned: 0 in 0.757s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:42 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a Jul 10 07:04:42 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:43 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a" returned: 0 in 0.703s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:43 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a Jul 10 07:04:43 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:44 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4.be972557-4ca9-4a0e-a842-5fc4621bd49a" returned: 0 in 0.657s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-be972557-4ca9-4a0e-a842-5fc4621bd49a" released by "_delete_snapshot" :: held 2.980s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-7ff2462f-f32c-4e79-91a6-fe281eac1da4" released by "delete_snapshot" :: held 3.003s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:44 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Created reservations ['e2275687-40aa-47ba-9da2-3da977186f38', 'b633305f-76f6-45d3-b03c-10084f523ef4', 'a01a894d-360b-481a-87ee-b7fa2b8d3908', 'afd32b39-e7c5-4988-a967-a25ff4e3c5ff'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:44 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Delete snapshot completed successfully. Jul 10 07:04:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-4dab1d6a-99e5-4284-8def-e7c9da8ce2f8 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-be972557-4ca9-4a0e-a842-5fc4621bd49a-delete_snapshot" released by "delete_snapshot" :: held 3.146s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-7ff2462f-f32c-4e79-91a6-fe281eac1da4-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-7ff2462f-f32c-4e79-91a6-fe281eac1da4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-7ff2462f-f32c-4e79-91a6-fe281eac1da4" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:44 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-7ff2462f-f32c-4e79-91a6-fe281eac1da4" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f0aeb-0108-40d0-9c6d-153086ba9a6f]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:44 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 Jul 10 07:04:44 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:45 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4" returned: 0 in 0.751s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:45 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4 Jul 10 07:04:45 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:45 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-7ff2462f-f32c-4e79-91a6-fe281eac1da4" returned: 0 in 0.635s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:45 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-7ff2462f-f32c-4e79-91a6-fe281eac1da4" released by "delete_volume" :: held 1.442s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:45 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Created reservations ['a68e40bb-bd80-4c5e-b59b-46a0ac842f9b', 'ef8b09a2-26c1-42c3-b951-7100d14f1dd2', 'da9429ad-afb0-453e-baac-1ccff8b4e5d5', '12c7b0de-f1a3-4941-9c5b-3793ba52ce9a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:45 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:45 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:04:45 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:46 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.644s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:04:46 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Deleted volume successfully. Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-77a3d07c-33d9-4e96-bb20-2058b9a1d495 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-7ff2462f-f32c-4e79-91a6-fe281eac1da4-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (7437463b-b31f-4736-9ea3-5008885f0d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d746400-c881-4879-8501-ff9df749a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d746400-c881-4879-8501-ff9df749a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918938526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b93024-b893-4885-acc8-51ea2f1e6661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:04:47Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca974d9-d911-40df-bb8f-0dc0d2b29980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca974d9-d911-40df-bb8f-0dc0d2b29980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8531d799-0440-462b-8ded-9d786c9c06ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8531d799-0440-462b-8ded-9d786c9c06ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b93024-b893-4885-acc8-51ea2f1e6661', 'volume_name': 'volume-58b93024-b893-4885-acc8-51ea2f1e6661', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f359df-7b4e-4761-8a4f-8ce96b6bf80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f359df-7b4e-4761-8a4f-8ce96b6bf80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97a946c-bbbf-4733-98c8-bad4de1bf465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:46 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Volume 58b93024-b893-4885-acc8-51ea2f1e6661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b93024-b893-4885-acc8-51ea2f1e6661', 'volume_size': 1} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918938526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b93024-b893-4885-acc8-51ea2f1e6661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:04:47Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Creating volume 58b93024-b893-4885-acc8-51ea2f1e6661 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:04:46 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:04:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:46 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 1073741824 Jul 10 07:04:46 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:47 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 1073741824" returned: 0 in 0.799s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:47 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 Jul 10 07:04:47 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:48 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661" returned: 0 in 0.641s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:04:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97a946c-bbbf-4733-98c8-bad4de1bf465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b93024-b893-4885-acc8-51ea2f1e6661', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343f5992-89f7-4299-b5f6-e03fb0d98605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:04:48 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Volume volume-58b93024-b893-4885-acc8-51ea2f1e6661 (58b93024-b893-4885-acc8-51ea2f1e6661): created successfully Jul 10 07:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343f5992-89f7-4299-b5f6-e03fb0d98605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:04:48 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (7437463b-b31f-4736-9ea3-5008885f0d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:04:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cc33283d-f666-4b03-9889-9934dbc1ea0b tempest-ProjectMemberTests-1413003193 None] Created volume successfully. Jul 10 07:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:04:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] Creating offline snapshot d9d23dce-c78b-4ac3-a5af-68eb1cd87483 of volume 58b93024-b893-4885-acc8-51ea2f1e6661 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:04:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[10490ee1-83bc-4de1-9dfc-4863a5682d68]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:49 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 Jul 10 07:04:49 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:49 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661" returned: 0 in 0.753s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:49 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 1G Jul 10 07:04:49 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:50 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 1G" returned: 0 in 0.788s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58b93024-b893-4885-acc8-51ea2f1e6661 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:50 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58b93024-b893-4885-acc8-51ea2f1e6661 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 Jul 10 07:04:50 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:51 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58b93024-b893-4885-acc8-51ea2f1e6661 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483" returned: 0 in 0.683s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:51 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 is being set with open permissions: ugo+rw Jul 10 07:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:51 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 Jul 10 07:04:51 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:51 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483" returned: 0 in 0.625s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:51 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.info Jul 10 07:04:51 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:52 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.info" returned: 0 in 0.660s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:52 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.info is being set with open permissions: ugo+rw Jul 10 07:04:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:52 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.info Jul 10 07:04:52 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:53 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.info" returned: 0 in 0.633s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.219s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:04:53 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-fb2f57f6-f7e1-42c3-8101-b981317ecfb6 tempest-ProjectMemberTests-1413003193 None] Create snapshot completed successfully Jul 10 07:04:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-d9d23dce-c78b-4ac3-a5af-68eb1cd87483-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-d9d23dce-c78b-4ac3-a5af-68eb1cd87483-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-58b93024-b893-4885-acc8-51ea2f1e6661" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-58b93024-b893-4885-acc8-51ea2f1e6661" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-d9d23dce-c78b-4ac3-a5af-68eb1cd87483" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-d9d23dce-c78b-4ac3-a5af-68eb1cd87483" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Deleting offline snapshot d9d23dce-c78b-4ac3-a5af-68eb1cd87483 of volume 58b93024-b893-4885-acc8-51ea2f1e6661 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:04:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] snapshot_file for this snap is: volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:04:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b9cd4d-581b-42b1-a122-2c0d1438b788]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:54 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 Jul 10 07:04:54 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:55 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483" returned: 0 in 0.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:55 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58b93024-b893-4885-acc8-51ea2f1e6661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:04:55 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[418c0c6c-a279-4124-8a2c-a67a2d77296b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:55 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 Jul 10 07:04:55 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:55 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661" returned: 0 in 0.773s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:55 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 Jul 10 07:04:55 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:56 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483" returned: 0 in 0.721s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:56 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483 Jul 10 07:04:56 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:57 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661.d9d23dce-c78b-4ac3-a5af-68eb1cd87483" returned: 0 in 0.639s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-d9d23dce-c78b-4ac3-a5af-68eb1cd87483" released by "_delete_snapshot" :: held 2.972s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-58b93024-b893-4885-acc8-51ea2f1e6661" released by "delete_snapshot" :: held 2.992s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:57 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=86,cinder:DELETE=8,cinder:INSERT=28,cinder:UPDATE=105 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:04:57 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Created reservations ['c7a45b49-f2b3-403b-a6f5-b1ecc3b111be', '050bed2a-8b85-49f9-b706-5957a0660d0e', 'bda83a80-269c-4e3e-94a9-83b5b68892a1', '54148142-4989-46d4-b8bc-db2f9ba23039'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:04:57 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Delete snapshot completed successfully. Jul 10 07:04:57 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-41bd76ba-5461-4e78-a13e-44c684217c66 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-d9d23dce-c78b-4ac3-a5af-68eb1cd87483-delete_snapshot" released by "delete_snapshot" :: held 3.187s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:04:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-58b93024-b893-4885-acc8-51ea2f1e6661-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-58b93024-b893-4885-acc8-51ea2f1e6661-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-58b93024-b893-4885-acc8-51ea2f1e6661" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:04:58 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-58b93024-b893-4885-acc8-51ea2f1e6661" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:04:58 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57af12b-463c-4571-918c-2c346b8ac884]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:04:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:58 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 Jul 10 07:04:58 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:59 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661" returned: 0 in 0.741s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:04:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:04:59 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661 Jul 10 07:04:59 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:04:59 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 10 07:04:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-58b93024-b893-4885-acc8-51ea2f1e6661" returned: 0 in 0.635s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-58b93024-b893-4885-acc8-51ea2f1e6661" released by "delete_volume" :: held 1.432s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:00 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Created reservations ['b39f1324-c921-4d5e-9797-530086274162', 'e9cdc8d7-5da8-4e2a-a79a-a9d3c621dc83', '3577c0bd-d892-4a61-a5d8-bfd7f7d503d0', '61657c1c-f6a4-43fe-9bb3-74397e0a520e'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:05:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:05:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:05:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:00 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:05:00 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:00 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.632s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:00 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:05:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Deleted volume successfully. Jul 10 07:05:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-face4aaa-45a2-4078-883e-bdedf02e7055 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-58b93024-b893-4885-acc8-51ea2f1e6661-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (addfbe44-a385-4e3a-a8da-13866a07794f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3be3b5b-886d-4d7d-bac5-7a46dd1592a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3be3b5b-886d-4d7d-bac5-7a46dd1592a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-8753671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f2d3c4-9517-44d9-adef-7026bd6ddc36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:05:01Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9b5429-cd23-4204-8d65-85ee94d59d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9b5429-cd23-4204-8d65-85ee94d59d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ff0f2f-1755-41de-b835-36be15b497c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ff0f2f-1755-41de-b835-36be15b497c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f2d3c4-9517-44d9-adef-7026bd6ddc36', 'volume_name': 'volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4e738f-c85d-4fb5-a656-d7e68adc6a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4e738f-c85d-4fb5-a656-d7e68adc6a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acce7490-2a69-4b52-95b6-b77d786df5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:01 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Volume 83f2d3c4-9517-44d9-adef-7026bd6ddc36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36', 'volume_size': 1} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-8753671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f2d3c4-9517-44d9-adef-7026bd6ddc36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:05:01Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Creating volume 83f2d3c4-9517-44d9-adef-7026bd6ddc36 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:05:01 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:05:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:01 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 1073741824 Jul 10 07:05:01 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:02 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 1073741824" returned: 0 in 0.802s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:02 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 Jul 10 07:05:02 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:02 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36" returned: 0 in 0.641s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:02 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:05:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acce7490-2a69-4b52-95b6-b77d786df5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405374c0-47d9-49d5-b6fa-d8b522791976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:02 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Volume volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 (83f2d3c4-9517-44d9-adef-7026bd6ddc36): created successfully Jul 10 07:05:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405374c0-47d9-49d5-b6fa-d8b522791976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:02 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (addfbe44-a385-4e3a-a8da-13866a07794f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:05:02 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-649f2b1d-475b-45e7-b7f4-725907b5e339 tempest-ProjectMemberTests-1413003193 None] Created volume successfully. Jul 10 07:05:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:03 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] Creating offline snapshot 2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 of volume 83f2d3c4-9517-44d9-adef-7026bd6ddc36 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:05:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8d2989-e46a-4cb5-8d4b-5c1286ae3898]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:03 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 Jul 10 07:05:03 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:04 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36" returned: 0 in 0.736s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:04 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 1G Jul 10 07:05:04 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:04 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 1G" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:04 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 Jul 10 07:05:04 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:05 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4" returned: 0 in 0.674s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:05 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 is being set with open permissions: ugo+rw Jul 10 07:05:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:05 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 Jul 10 07:05:05 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:06 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4" returned: 0 in 0.645s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:06 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=98,cinder:INSERT=40,cinder:UPDATE=135,cinder:DELETE=10 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:05:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:06 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.info Jul 10 07:05:06 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:06 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.info" returned: 0 in 0.629s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:06 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.info is being set with open permissions: ugo+rw Jul 10 07:05:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:06 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.info Jul 10 07:05:06 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:07 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.info" returned: 0 in 0.631s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.169s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:07 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-96af00bf-1d69-445c-b852-d5175a3922b4 tempest-ProjectMemberTests-1413003193 None] Create snapshot completed successfully Jul 10 07:05:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-2b0e691e-7f08-45a1-b9dc-fed06f69ebf4-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Lock "cinder-2b0e691e-7f08-45a1-b9dc-fed06f69ebf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-83f2d3c4-9517-44d9-adef-7026bd6ddc36" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-83f2d3c4-9517-44d9-adef-7026bd6ddc36" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-2b0e691e-7f08-45a1-b9dc-fed06f69ebf4" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-2b0e691e-7f08-45a1-b9dc-fed06f69ebf4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Deleting offline snapshot 2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 of volume 83f2d3c4-9517-44d9-adef-7026bd6ddc36 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:05:08 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] snapshot_file for this snap is: volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:05:08 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[64342cae-f642-493d-9293-dc320704f64c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:08 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 Jul 10 07:05:08 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:09 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4" returned: 0 in 0.746s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:09 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:05:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[665a6bb1-65f6-4f8f-a9b5-2c5a56834341]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:09 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 Jul 10 07:05:09 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:10 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36" returned: 0 in 0.750s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:10 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 Jul 10 07:05:10 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:10 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4" returned: 0 in 0.738s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:10 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4 Jul 10 07:05:10 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:11 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36.2b0e691e-7f08-45a1-b9dc-fed06f69ebf4" returned: 0 in 0.646s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-2b0e691e-7f08-45a1-b9dc-fed06f69ebf4" released by "_delete_snapshot" :: held 2.967s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-83f2d3c4-9517-44d9-adef-7026bd6ddc36" released by "delete_snapshot" :: held 2.986s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:11 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:05:11 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Created reservations ['5f77d02f-c610-4ffe-a2b1-14372fb0a998', 'e6bad75c-81b2-4e18-9582-47ed2141ad23', '6e49d2d4-9057-42f8-9a8f-633b81be8c0f', '6515c2af-a346-4f95-b32e-9b50da830637'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:05:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Delete snapshot completed successfully. Jul 10 07:05:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-c3b61e05-5008-46b4-b0d2-f4230cf82c0c tempest-ProjectMemberTests-1413003193 None] Lock "cinder-2b0e691e-7f08-45a1-b9dc-fed06f69ebf4-delete_snapshot" released by "delete_snapshot" :: held 3.151s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:12 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.656s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:05:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:05:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:05:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-83f2d3c4-9517-44d9-adef-7026bd6ddc36-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-83f2d3c4-9517-44d9-adef-7026bd6ddc36-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-83f2d3c4-9517-44d9-adef-7026bd6ddc36" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:12 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-83f2d3c4-9517-44d9-adef-7026bd6ddc36" acquired by "delete_volume" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:12 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[553790f0-cc5b-4255-b0c7-2d09a10519d7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:13 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 Jul 10 07:05:13 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:13 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36" returned: 0 in 0.750s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:13 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36 Jul 10 07:05:13 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:14 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-83f2d3c4-9517-44d9-adef-7026bd6ddc36" returned: 0 in 0.655s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:14 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-83f2d3c4-9517-44d9-adef-7026bd6ddc36" released by "delete_volume" :: held 1.460s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:14 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Created reservations ['17498a1b-5ea3-4963-9c72-e930fe66f8a7', '549ed2c3-13dc-43ce-b215-23ba362de940', 'a2bd43cb-d84b-4bc8-b2c4-e9971a3f76fc', '615d5c95-4a23-4358-bdff-9db6816b01c5'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:05:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:05:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:05:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:14 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:05:14 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:15 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.655s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:05:15 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Deleted volume successfully. Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ef9d56f7-e487-4b38-aa13-5ca3b6abc208 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-83f2d3c4-9517-44d9-adef-7026bd6ddc36-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (8f8a1fa2-2f3c-4e24-8ec4-3bd7a17ddf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6c90c6-df52-47c1-ae3a-e957e39964fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6c90c6-df52-47c1-ae3a-e957e39964fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803896538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5ead49-72f9-4147-9760-d63a1262b020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:05:15Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74d4c29-710a-49f1-868f-4ba3ccb6b541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74d4c29-710a-49f1-868f-4ba3ccb6b541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7535c324-defb-4a2b-ab5b-0cfdea0b662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7535c324-defb-4a2b-ab5b-0cfdea0b662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd5ead49-72f9-4147-9760-d63a1262b020', 'volume_name': 'volume-cd5ead49-72f9-4147-9760-d63a1262b020', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e686d2c6-75a8-4a63-90d4-b58194537a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e686d2c6-75a8-4a63-90d4-b58194537a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c621af3-a54a-4596-9015-d26dc44aaeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:15 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Volume cd5ead49-72f9-4147-9760-d63a1262b020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd5ead49-72f9-4147-9760-d63a1262b020', 'volume_size': 1} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-803896538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd5ead49-72f9-4147-9760-d63a1262b020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:05:15Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Creating volume cd5ead49-72f9-4147-9760-d63a1262b020 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:05:15 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:05:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:15 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 1073741824 Jul 10 07:05:15 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:16 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 1073741824" returned: 0 in 0.798s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:16 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 Jul 10 07:05:16 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:16 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020" returned: 0 in 0.631s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:16 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:05:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c621af3-a54a-4596-9015-d26dc44aaeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd5ead49-72f9-4147-9760-d63a1262b020', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83376f4d-fb43-48be-880d-6f32e34784db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:17 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Volume volume-cd5ead49-72f9-4147-9760-d63a1262b020 (cd5ead49-72f9-4147-9760-d63a1262b020): created successfully Jul 10 07:05:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83376f4d-fb43-48be-880d-6f32e34784db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:17 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (8f8a1fa2-2f3c-4e24-8ec4-3bd7a17ddf60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:05:17 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-9379ac8b-7d94-4f97-a0f1-6ddbb0ac6005 tempest-ProjectMemberTests-1413003193 None] Created volume successfully. Jul 10 07:05:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:17 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] Creating offline snapshot 016dea9e-75a8-436e-90a2-40ce47b55b3b of volume cd5ead49-72f9-4147-9760-d63a1262b020 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:05:17 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e09ee8-6472-416a-b414-a0676fabafd2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:17 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 Jul 10 07:05:17 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:18 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020" returned: 0 in 0.743s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:18 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b 1G Jul 10 07:05:18 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:19 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b 1G" returned: 0 in 0.782s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5ead49-72f9-4147-9760-d63a1262b020 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:19 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5ead49-72f9-4147-9760-d63a1262b020 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b Jul 10 07:05:19 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:19 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd5ead49-72f9-4147-9760-d63a1262b020 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b" returned: 0 in 0.668s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:19 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b is being set with open permissions: ugo+rw Jul 10 07:05:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:19 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b Jul 10 07:05:19 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:20 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b" returned: 0 in 0.649s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:20 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.info Jul 10 07:05:20 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:21 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.info" returned: 0 in 0.657s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:21 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.info is being set with open permissions: ugo+rw Jul 10 07:05:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:21 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.info Jul 10 07:05:21 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:21 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.info" returned: 0 in 0.624s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:21 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-66381671-08a3-43dd-9ed9-63a4c1f18657 tempest-ProjectMemberTests-1413003193 None] Create snapshot completed successfully Jul 10 07:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-016dea9e-75a8-436e-90a2-40ce47b55b3b-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-016dea9e-75a8-436e-90a2-40ce47b55b3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-cd5ead49-72f9-4147-9760-d63a1262b020" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-cd5ead49-72f9-4147-9760-d63a1262b020" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-016dea9e-75a8-436e-90a2-40ce47b55b3b" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-016dea9e-75a8-436e-90a2-40ce47b55b3b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Deleting offline snapshot 016dea9e-75a8-436e-90a2-40ce47b55b3b of volume cd5ead49-72f9-4147-9760-d63a1262b020 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:05:22 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] snapshot_file for this snap is: volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:05:22 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef135ba-0b5b-4e7d-8910-0cf0e09b94af]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:23 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b Jul 10 07:05:23 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:23 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b" returned: 0 in 0.749s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:23 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd5ead49-72f9-4147-9760-d63a1262b020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:05:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[4321f963-c1dc-4c5e-8288-b314e538fb95]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:23 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 Jul 10 07:05:23 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:24 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020" returned: 0 in 0.756s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:24 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b Jul 10 07:05:24 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:25 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b" returned: 0 in 0.763s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:25 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b Jul 10 07:05:25 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:25 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020.016dea9e-75a8-436e-90a2-40ce47b55b3b" returned: 0 in 0.626s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-016dea9e-75a8-436e-90a2-40ce47b55b3b" released by "_delete_snapshot" :: held 2.976s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-cd5ead49-72f9-4147-9760-d63a1262b020" released by "delete_snapshot" :: held 2.995s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:25 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Created reservations ['0e875e81-d785-460d-b49e-f7855ecc24af', 'af314668-b989-44a5-8875-5df277205827', 'fbe30bdf-b4df-4935-bb93-96eb0a55c6e0', '1485f967-19b3-40b2-834d-c929002b355f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:05:26 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Delete snapshot completed successfully. Jul 10 07:05:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-e91f13cd-56a6-4919-b751-75284fe22862 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-016dea9e-75a8-436e-90a2-40ce47b55b3b-delete_snapshot" released by "delete_snapshot" :: held 3.125s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-cd5ead49-72f9-4147-9760-d63a1262b020-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-cd5ead49-72f9-4147-9760-d63a1262b020-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-cd5ead49-72f9-4147-9760-d63a1262b020" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:26 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-cd5ead49-72f9-4147-9760-d63a1262b020" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:26 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[0beff758-1e69-4ed9-9c22-097cb6c1a478]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:26 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 Jul 10 07:05:26 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:26 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020" returned: 0 in 0.746s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:26 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020 Jul 10 07:05:26 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:27 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-cd5ead49-72f9-4147-9760-d63a1262b020" returned: 0 in 0.647s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:27 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-cd5ead49-72f9-4147-9760-d63a1262b020" released by "delete_volume" :: held 1.444s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:27 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Created reservations ['602f2cc6-43b0-4e65-a3e5-8391cc017ac3', '1e11e64e-7299-4b40-ad79-9b0d34d4abd1', 'aad71ec0-3c52-406c-aa1f-d27a4422ed73', '840d215e-2c65-4746-a816-2cd6c72cf97b'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:05:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:05:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:05:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:27 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:05:27 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:28 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.639s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:05:28 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Deleted volume successfully. Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1c66f4ea-d48f-41a3-99f2-6897291336c6 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-cd5ead49-72f9-4147-9760-d63a1262b020-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (38b46eb8-f2d3-4332-b08b-225c6b63c85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579cf8de-e1a4-4056-9e32-f3b651a93031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579cf8de-e1a4-4056-9e32-f3b651a93031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1816906973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55460730-807f-42bb-836b-2a21651bf5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:05:29Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8e51d8-4029-4a90-8be2-5be8ef34c7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb8e51d8-4029-4a90-8be2-5be8ef34c7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa32fa3-26f4-4b7d-98d9-52fc7c919b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa32fa3-26f4-4b7d-98d9-52fc7c919b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55460730-807f-42bb-836b-2a21651bf5e9', 'volume_name': 'volume-55460730-807f-42bb-836b-2a21651bf5e9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485a6c58-aeaf-4028-b39d-c2a5b51770ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485a6c58-aeaf-4028-b39d-c2a5b51770ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a12819-890c-46f2-bcef-61f0966e3fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:28 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Volume 55460730-807f-42bb-836b-2a21651bf5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55460730-807f-42bb-836b-2a21651bf5e9', 'volume_size': 1} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1816906973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55460730-807f-42bb-836b-2a21651bf5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:05:29Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Creating volume 55460730-807f-42bb-836b-2a21651bf5e9 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:05:28 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:05:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:28 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 1073741824 Jul 10 07:05:28 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:29 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 1073741824" returned: 0 in 0.785s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:29 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 Jul 10 07:05:29 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:30 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9" returned: 0 in 0.649s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a12819-890c-46f2-bcef-61f0966e3fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55460730-807f-42bb-836b-2a21651bf5e9', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b00a36f-42d4-4cf4-aa3b-fa75b4d273d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:30 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Volume volume-55460730-807f-42bb-836b-2a21651bf5e9 (55460730-807f-42bb-836b-2a21651bf5e9): created successfully Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b00a36f-42d4-4cf4-aa3b-fa75b4d273d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (38b46eb8-f2d3-4332-b08b-225c6b63c85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:05:30 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-f95f759c-4610-4993-b50b-834547c27354 tempest-ProjectMemberTests-1413003193 None] Created volume successfully. Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] Creating offline snapshot 48c0b734-cdc9-4086-b195-45db473525db of volume 55460730-807f-42bb-836b-2a21651bf5e9 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d905ee8-a014-4511-b0e0-141927632d30]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:31 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 Jul 10 07:05:31 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:31 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9" returned: 0 in 0.753s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:31 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db 1G Jul 10 07:05:31 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:32 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db 1G" returned: 0 in 0.781s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55460730-807f-42bb-836b-2a21651bf5e9 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:32 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55460730-807f-42bb-836b-2a21651bf5e9 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db Jul 10 07:05:32 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:33 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55460730-807f-42bb-836b-2a21651bf5e9 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db" returned: 0 in 0.682s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:33 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db is being set with open permissions: ugo+rw Jul 10 07:05:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:33 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db Jul 10 07:05:33 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:33 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db" returned: 0 in 0.651s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:33 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.info Jul 10 07:05:33 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:34 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.info" returned: 0 in 0.654s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:34 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.info is being set with open permissions: ugo+rw Jul 10 07:05:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:34 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.info Jul 10 07:05:34 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:35 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.info" returned: 0 in 0.630s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.227s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:35 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5ef35887-5268-4f74-bf2e-9c3498f82bc5 tempest-ProjectMemberTests-1413003193 None] Create snapshot completed successfully Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-48c0b734-cdc9-4086-b195-45db473525db-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Lock "cinder-48c0b734-cdc9-4086-b195-45db473525db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-55460730-807f-42bb-836b-2a21651bf5e9" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-55460730-807f-42bb-836b-2a21651bf5e9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-48c0b734-cdc9-4086-b195-45db473525db" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-48c0b734-cdc9-4086-b195-45db473525db" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Deleting offline snapshot 48c0b734-cdc9-4086-b195-45db473525db of volume 55460730-807f-42bb-836b-2a21651bf5e9 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] snapshot_file for this snap is: volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e1a9d8-5858-45a0-b584-99e68ca1dd8c]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:36 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db Jul 10 07:05:36 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:36 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db" returned: 0 in 0.733s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55460730-807f-42bb-836b-2a21651bf5e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bae16a9-1b23-4e13-a4e1-666c99b0906e]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:37 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 Jul 10 07:05:37 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:37 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9" returned: 0 in 0.731s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:37 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db Jul 10 07:05:37 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:38 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db" returned: 0 in 0.737s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:38 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db Jul 10 07:05:38 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:39 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9.48c0b734-cdc9-4086-b195-45db473525db" returned: 0 in 0.627s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-48c0b734-cdc9-4086-b195-45db473525db" released by "_delete_snapshot" :: held 2.914s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-55460730-807f-42bb-836b-2a21651bf5e9" released by "delete_snapshot" :: held 2.934s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:39 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Created reservations ['b4bd3694-4791-4a80-ade9-c3e1428d0780', '1398c148-4e93-42b6-91b3-1abaaff9e90e', '487e8687-c76f-4ad9-9481-0d43cfa2294e', '87a76488-51ac-42fa-9e24-100c243299f5'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:05:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Delete snapshot completed successfully. Jul 10 07:05:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-389e4713-22fc-4e7d-b84c-b8076d454d3e tempest-ProjectMemberTests-1413003193 None] Lock "cinder-48c0b734-cdc9-4086-b195-45db473525db-delete_snapshot" released by "delete_snapshot" :: held 3.059s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-55460730-807f-42bb-836b-2a21651bf5e9-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-55460730-807f-42bb-836b-2a21651bf5e9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-55460730-807f-42bb-836b-2a21651bf5e9" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-55460730-807f-42bb-836b-2a21651bf5e9" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:39 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad56fa2-2f5a-4bbc-a01f-35ec42611dc2]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:39 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 Jul 10 07:05:39 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:40 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9" returned: 0 in 0.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:40 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9 Jul 10 07:05:40 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:40 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-55460730-807f-42bb-836b-2a21651bf5e9" returned: 0 in 0.635s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:40 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-55460730-807f-42bb-836b-2a21651bf5e9" released by "delete_volume" :: held 1.447s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:40 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Created reservations ['6e08f4eb-9366-4cb8-8aef-86a85dd8a8c2', 'a90ac583-9025-4409-a7ab-2065a3817fe9', '6cc50ee8-5bd5-4767-8279-2486a1290325', 'f2e1ff1f-076b-4c1a-a9d8-4d7492dfb034'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:05:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:05:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:05:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:40 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:05:40 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:41 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.641s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:41 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:05:41 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Deleted volume successfully. Jul 10 07:05:41 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-70c90bb5-2daf-4980-8b12-b8e6c3282d43 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-55460730-807f-42bb-836b-2a21651bf5e9-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (4bb41a46-c688-497a-bc43-655c0338c866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c056f0-6136-43a1-a091-6c04561c6a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:41 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c056f0-6136-43a1-a091-6c04561c6a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489031469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e34c73-5d4b-4f3f-9f0c-412605da3d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:05:42Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a843f5-9029-476e-8c9f-d556beeb5459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a843f5-9029-476e-8c9f-d556beeb5459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b78019-9548-4c0a-b477-d5a9f9adcb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b78019-9548-4c0a-b477-d5a9f9adcb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e34c73-5d4b-4f3f-9f0c-412605da3d73', 'volume_name': 'volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529547ca-8938-4635-8e9e-468bebecd344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529547ca-8938-4635-8e9e-468bebecd344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0643ecc-0456-4429-ab8a-56ad372d5922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:42 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Volume a4e34c73-5d4b-4f3f-9f0c-412605da3d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73', 'volume_size': 1} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489031469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e34c73-5d4b-4f3f-9f0c-412605da3d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246729ec613f4fec94315ce3ec1567f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:05:42Z,use_quota=True,user_id='96d09e7b582e4671a19f19e15c728f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Creating volume a4e34c73-5d4b-4f3f-9f0c-412605da3d73 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:05:42 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:42 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 1073741824 Jul 10 07:05:42 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:42 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 1073741824" returned: 0 in 0.791s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:42 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 Jul 10 07:05:42 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:43 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73" returned: 0 in 0.656s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:43 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:05:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0643ecc-0456-4429-ab8a-56ad372d5922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388b463d-0f8f-4c73-baab-a081c2603798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:43 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Volume volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 (a4e34c73-5d4b-4f3f-9f0c-412605da3d73): created successfully Jul 10 07:05:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388b463d-0f8f-4c73-baab-a081c2603798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:43 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Flow 'volume_create_manager' (4bb41a46-c688-497a-bc43-655c0338c866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:05:43 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-8c809e93-1b54-42ca-bc26-6d6994cce704 tempest-ProjectMemberTests-1413003193 None] Created volume successfully. Jul 10 07:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:44 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] Creating offline snapshot fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 of volume a4e34c73-5d4b-4f3f-9f0c-412605da3d73 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:05:44 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1937bbde-ff0f-4b5a-bb98-ef4bb3f245d7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:44 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 Jul 10 07:05:44 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:44 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:44 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 1G Jul 10 07:05:44 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:45 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 1G" returned: 0 in 0.773s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:45 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 Jul 10 07:05:45 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:46 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18" returned: 0 in 0.670s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:46 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 is being set with open permissions: ugo+rw Jul 10 07:05:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:46 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 Jul 10 07:05:46 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:47 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18" returned: 0 in 0.630s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:47 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.info Jul 10 07:05:47 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:47 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.info" returned: 0 in 0.637s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:47 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.info is being set with open permissions: ugo+rw Jul 10 07:05:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:47 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.info Jul 10 07:05:47 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:48 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.info" returned: 0 in 0.623s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.146s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:48 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d5cd95de-f650-4edd-8cec-870e1cab7110 tempest-ProjectMemberTests-1413003193 None] Create snapshot completed successfully Jul 10 07:05:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-a4e34c73-5d4b-4f3f-9f0c-412605da3d73" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-a4e34c73-5d4b-4f3f-9f0c-412605da3d73" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Deleting offline snapshot fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 of volume a4e34c73-5d4b-4f3f-9f0c-412605da3d73 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:05:49 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] snapshot_file for this snap is: volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:05:49 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb4a392-eac4-4624-90db-089f652a8e06]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:49 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 Jul 10 07:05:49 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:50 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18" returned: 0 in 0.744s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:50 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:05:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaa3e96-e662-4379-915b-869016a5f13a]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:50 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 Jul 10 07:05:50 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:51 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73" returned: 0 in 0.729s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:51 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 Jul 10 07:05:51 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:51 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18" returned: 0 in 0.701s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:51 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18 Jul 10 07:05:51 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:52 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73.fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18" returned: 0 in 0.637s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18" released by "_delete_snapshot" :: held 2.896s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-a4e34c73-5d4b-4f3f-9f0c-412605da3d73" released by "delete_snapshot" :: held 2.919s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:52 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Created reservations ['9e1432e2-52d3-4599-af58-2c2d26133c66', '1b926dd8-d341-417e-b147-5f4712491d36', 'a1d37a1f-ea34-4c94-9e31-eabba6fd025b', 'ce4f4fc6-d216-4e55-9306-a9d2085bba73'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:05:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Delete snapshot completed successfully. Jul 10 07:05:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-80f00f41-5b99-43c5-af33-dd2ff86df354 tempest-ProjectMemberTests-1413003193 None] Lock "cinder-fe1cc717-57fe-4cf6-8ca7-62a1d27a1c18-delete_snapshot" released by "delete_snapshot" :: held 3.051s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-a4e34c73-5d4b-4f3f-9f0c-412605da3d73-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Lock "cinder-a4e34c73-5d4b-4f3f-9f0c-412605da3d73-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Acquiring lock "cinder-quobyte-a4e34c73-5d4b-4f3f-9f0c-412605da3d73" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:05:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-a4e34c73-5d4b-4f3f-9f0c-412605da3d73" acquired by "delete_volume" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:05:52 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[875fbe68-6527-44ba-a844-f66a2c68b2be]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:05:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:52 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 Jul 10 07:05:52 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:53 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73" returned: 0 in 0.744s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:53 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73 Jul 10 07:05:53 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:54 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-a4e34c73-5d4b-4f3f-9f0c-412605da3d73" returned: 0 in 0.639s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Lock "cinder-quobyte-a4e34c73-5d4b-4f3f-9f0c-412605da3d73" released by "delete_volume" :: held 1.440s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Created reservations ['a1277aac-dcf8-4901-a3e8-5fc5391c3d7e', '70c8c3ca-8655-4b51-89cc-3a732e9cf26a', 'bf90e97e-9703-4191-a511-58f75a1e5b3a', 'cf929f18-df11-460d-9c79-34cc4c9fe014'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:54 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:05:54 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:54 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.647s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:05:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Deleted volume successfully. Jul 10 07:05:54 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-cf398491-4296-4eb5-af37-40c18392c24b tempest-ProjectMemberTests-1413003193 None] Lock "cinder-a4e34c73-5d4b-4f3f-9f0c-412605da3d73-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Flow 'volume_create_manager' (489bba1d-86b8-42d2-a8c6-22825ff82cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e44538-a602-4469-a8e7-bebb3f66662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=89,cinder:SELECT=69,cinder:INSERT=19,cinder:DELETE=9 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e44538-a602-4469-a8e7-bebb3f66662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-588584866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b1bca0-8ba7-488f-9b51-b4837ae6bc62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd46d3711874c4bbe41187df4b18313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:05:58Z,use_quota=True,user_id='7117053ef1bf42f182603347dca3640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec69329b-4806-4313-bbca-a4298bcba757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec69329b-4806-4313-bbca-a4298bcba757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc9a658-84cd-46a3-82e5-62b9fbce61b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc9a658-84cd-46a3-82e5-62b9fbce61b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b1bca0-8ba7-488f-9b51-b4837ae6bc62', 'volume_name': 'volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3e90df-8460-4ede-9995-a551524bb7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3e90df-8460-4ede-9995-a551524bb7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185d67c4-d615-4ed0-9741-d741166281b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:05:58 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Volume b8b1bca0-8ba7-488f-9b51-b4837ae6bc62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62', 'volume_size': 1} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-588584866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b1bca0-8ba7-488f-9b51-b4837ae6bc62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd46d3711874c4bbe41187df4b18313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:05:58Z,use_quota=True,user_id='7117053ef1bf42f182603347dca3640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Creating volume b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:05:58 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:05:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:58 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 1073741824 Jul 10 07:05:58 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:05:59 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 10 07:05:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 1073741824" returned: 0 in 0.805s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:05:59 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:05:59 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 Jul 10 07:05:59 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:00 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62" returned: 0 in 0.635s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185d67c4-d615-4ed0-9741-d741166281b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34908d8-d13c-4f3f-95d2-f43863794213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:00 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Volume volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 (b8b1bca0-8ba7-488f-9b51-b4837ae6bc62): created successfully Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34908d8-d13c-4f3f-95d2-f43863794213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Flow 'volume_create_manager' (489bba1d-86b8-42d2-a8c6-22825ff82cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:06:00 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1c8df24c-1728-4ec2-afb6-f919330844e5 tempest-ProjectReaderTests-1850744707 None] Created volume successfully. Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] Creating offline snapshot 6c04db96-71a4-44ad-8d55-bdda89591018 of volume b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be0caf5-ac12-4025-8a04-3ad8a3842659]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:00 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 Jul 10 07:06:00 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:01 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62" returned: 0 in 0.744s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:01 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 1G Jul 10 07:06:01 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:02 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 1G" returned: 0 in 0.772s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:02 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 Jul 10 07:06:02 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:02 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018" returned: 0 in 0.672s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:02 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 is being set with open permissions: ugo+rw Jul 10 07:06:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:02 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 Jul 10 07:06:02 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:03 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018" returned: 0 in 0.650s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:03 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.info Jul 10 07:06:03 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:04 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.info" returned: 0 in 0.670s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:04 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.info is being set with open permissions: ugo+rw Jul 10 07:06:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:04 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.info Jul 10 07:06:04 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:04 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.info" returned: 0 in 0.645s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.224s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:04 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-06b35378-eabd-40c0-ae7f-80d4e478d878 tempest-ProjectReaderTests-1850744707 None] Create snapshot completed successfully Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-6c04db96-71a4-44ad-8d55-bdda89591018-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-6c04db96-71a4-44ad-8d55-bdda89591018-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-6c04db96-71a4-44ad-8d55-bdda89591018" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-6c04db96-71a4-44ad-8d55-bdda89591018" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Deleting offline snapshot 6c04db96-71a4-44ad-8d55-bdda89591018 of volume b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] snapshot_file for this snap is: volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3077f1b6-5eec-4d90-bbb6-f1160fb21c89]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:06 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 Jul 10 07:06:06 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:06 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018" returned: 0 in 0.735s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[638719d0-273f-469c-87d2-a1a6ba9e5885]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:06 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:06 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 Jul 10 07:06:06 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:07 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62" returned: 0 in 0.748s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:07 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:07 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 Jul 10 07:06:07 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:08 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018" returned: 0 in 0.709s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:08 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018 Jul 10 07:06:08 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:08 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:08 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62.6c04db96-71a4-44ad-8d55-bdda89591018" returned: 0 in 0.628s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:08 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-6c04db96-71a4-44ad-8d55-bdda89591018" released by "_delete_snapshot" :: held 2.908s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62" released by "delete_snapshot" :: held 2.928s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:09 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:UPDATE=67,cinder:DELETE=5,cinder:SELECT=53,cinder:INSERT=22 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:06:09 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Created reservations ['fe3cdbba-0882-4948-ae52-907bb539ce17', '7a3edb26-7199-46dc-96ca-0a6a8461aade', '4487957d-f643-4bb3-98bb-3f9cde9f76ca', 'a198e09e-056e-49ca-925f-3ab026fbf31a'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:06:09 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Delete snapshot completed successfully. Jul 10 07:06:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-79f95122-87b4-480b-ac60-b9d7fd920c4f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-6c04db96-71a4-44ad-8d55-bdda89591018-delete_snapshot" released by "delete_snapshot" :: held 3.065s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:09 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:09 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[964e43b5-ab47-4d7a-a7fb-51937ede38d5]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:09 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:09 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 Jul 10 07:06:09 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:10 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62" returned: 0 in 0.736s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:10 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62 Jul 10 07:06:10 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:10 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62" returned: 0 in 0.621s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:10 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62" released by "delete_volume" :: held 1.414s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:10 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Created reservations ['444db219-40ff-4348-af3e-8308e74a4e32', 'a5a2c170-5dfc-4c42-87bb-a807945f9612', 'df87ac89-da58-4fd5-bf10-400764a4fdb1', '864489e0-cf8f-4e38-a1c4-30653ac810ca'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:06:10 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:10 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:10 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:06:10 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:11 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.631s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:06:11 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Deleted volume successfully. Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-7acb34cb-131c-4d55-839e-5085f8045401 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-b8b1bca0-8ba7-488f-9b51-b4837ae6bc62-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:11 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:06:11 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Flow 'volume_create_manager' (af53d388-9888-4b04-a586-4e86c3d0a652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a99954c-7dae-434d-b4b4-83a944a457d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a99954c-7dae-434d-b4b4-83a944a457d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607299296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e6036d-1ade-4511-8507-d19039df5eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd46d3711874c4bbe41187df4b18313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:06:12Z,use_quota=True,user_id='7117053ef1bf42f182603347dca3640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f0732b-2250-4d61-9f32-53417d5a8bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f0732b-2250-4d61-9f32-53417d5a8bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd3029b-8070-4f60-bc4c-c39bd643711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd3029b-8070-4f60-bc4c-c39bd643711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e6036d-1ade-4511-8507-d19039df5eff', 'volume_name': 'volume-c1e6036d-1ade-4511-8507-d19039df5eff', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa35a6ef-5644-42f7-95e2-8cdb64904c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa35a6ef-5644-42f7-95e2-8cdb64904c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b3b76e-9322-4106-8f84-a035bd7cc212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:11 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Volume c1e6036d-1ade-4511-8507-d19039df5eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e6036d-1ade-4511-8507-d19039df5eff', 'volume_size': 1} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607299296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e6036d-1ade-4511-8507-d19039df5eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd46d3711874c4bbe41187df4b18313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:06:12Z,use_quota=True,user_id='7117053ef1bf42f182603347dca3640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Creating volume c1e6036d-1ade-4511-8507-d19039df5eff {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:06:11 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:06:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:11 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff 1073741824 Jul 10 07:06:11 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:12 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.710s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:06:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:06:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:06:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:06:12 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff 1073741824" returned: 0 in 0.829s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:12 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff Jul 10 07:06:12 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:13 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff" returned: 0 in 0.666s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:06:13 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b3b76e-9322-4106-8f84-a035bd7cc212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e6036d-1ade-4511-8507-d19039df5eff', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe29fe9-c667-4265-9b03-5d78d8270c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:13 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Volume volume-c1e6036d-1ade-4511-8507-d19039df5eff (c1e6036d-1ade-4511-8507-d19039df5eff): created successfully Jul 10 07:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe29fe9-c667-4265-9b03-5d78d8270c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:13 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Flow 'volume_create_manager' (af53d388-9888-4b04-a586-4e86c3d0a652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:06:13 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5d7e48cf-e643-4996-8ebf-f9d7126ded95 tempest-ProjectReaderTests-1850744707 None] Created volume successfully. Jul 10 07:06:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:14 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] Creating offline snapshot 53c3eee4-b083-4534-9094-104720f11a06 of volume c1e6036d-1ade-4511-8507-d19039df5eff {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:06:14 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ada302-4b59-4874-ac4f-6d215a346681]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:14 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff Jul 10 07:06:14 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:14 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff" returned: 0 in 0.765s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:14 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:14 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 1G Jul 10 07:06:14 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:15 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 1G" returned: 0 in 0.782s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:15 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e6036d-1ade-4511-8507-d19039df5eff -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:15 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e6036d-1ade-4511-8507-d19039df5eff -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 Jul 10 07:06:15 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:16 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e6036d-1ade-4511-8507-d19039df5eff -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06" returned: 0 in 0.687s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:16 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 is being set with open permissions: ugo+rw Jul 10 07:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:16 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 Jul 10 07:06:16 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:16 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06" returned: 0 in 0.624s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:16 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:16 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.info Jul 10 07:06:16 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:17 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.info" returned: 0 in 0.643s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:17 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.info is being set with open permissions: ugo+rw Jul 10 07:06:17 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:17 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.info Jul 10 07:06:17 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:18 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.info" returned: 0 in 0.627s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:18 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.208s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:18 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ad6561a7-7f5d-41fc-88d9-8bbb32183cf2 tempest-ProjectReaderTests-1850744707 None] Create snapshot completed successfully Jul 10 07:06:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-53c3eee4-b083-4534-9094-104720f11a06-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-53c3eee4-b083-4534-9094-104720f11a06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-c1e6036d-1ade-4511-8507-d19039df5eff" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-c1e6036d-1ade-4511-8507-d19039df5eff" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-53c3eee4-b083-4534-9094-104720f11a06" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:19 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-53c3eee4-b083-4534-9094-104720f11a06" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Deleting offline snapshot 53c3eee4-b083-4534-9094-104720f11a06 of volume c1e6036d-1ade-4511-8507-d19039df5eff {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:06:19 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] snapshot_file for this snap is: volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:06:19 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0add2c7-5b09-4f94-8064-6e37dc42db5d]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:19 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:19 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 Jul 10 07:06:19 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:20 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:20 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1e6036d-1ade-4511-8507-d19039df5eff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:06:20 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eab2ed6-b5b4-4fd2-b189-c715051f8d51]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:20 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff Jul 10 07:06:20 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:20 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff" returned: 0 in 0.770s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:20 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:20 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 Jul 10 07:06:20 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:21 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06" returned: 0 in 0.711s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:21 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:21 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06 Jul 10 07:06:21 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:22 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:22 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff.53c3eee4-b083-4534-9094-104720f11a06" returned: 0 in 0.654s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-53c3eee4-b083-4534-9094-104720f11a06" released by "_delete_snapshot" :: held 2.989s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-c1e6036d-1ade-4511-8507-d19039df5eff" released by "delete_snapshot" :: held 3.011s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:22 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Created reservations ['867d7a18-c33d-49d3-bda1-5d6f621e4774', '6e79bb1c-60a4-4c56-b8ff-239e69011bb1', '4b4d611d-d099-4e46-adba-407f7f077117', '0c3ba96a-d1e0-489f-8fcd-910012eb1261'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:06:22 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Delete snapshot completed successfully. Jul 10 07:06:22 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-69e958fe-a6b0-453a-9e63-a2a322d4af7f tempest-ProjectReaderTests-1850744707 None] Lock "cinder-53c3eee4-b083-4534-9094-104720f11a06-delete_snapshot" released by "delete_snapshot" :: held 3.133s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-c1e6036d-1ade-4511-8507-d19039df5eff-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Lock "cinder-c1e6036d-1ade-4511-8507-d19039df5eff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-c1e6036d-1ade-4511-8507-d19039df5eff" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:23 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-c1e6036d-1ade-4511-8507-d19039df5eff" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:23 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad728ad2-b989-4ed9-85a2-2da20f0479d7]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:23 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:23 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff Jul 10 07:06:23 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:24 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff" returned: 0 in 0.755s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:24 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff Jul 10 07:06:24 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:24 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:24 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-c1e6036d-1ade-4511-8507-d19039df5eff" returned: 0 in 0.643s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:24 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-c1e6036d-1ade-4511-8507-d19039df5eff" released by "delete_volume" :: held 1.452s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:25 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Created reservations ['820d9cfe-c553-4780-9131-f068fb0909f6', '72aef837-9c9a-4b5b-9e3c-4de8b43edb91', '0cc89cdf-269f-47cc-9970-97a073e9a77d', 'c8804bef-5353-45a9-b7d0-e78970e405a7'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:06:25 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:25 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:06:25 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:25 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:25 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.650s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:25 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:06:25 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Deleted volume successfully. Jul 10 07:06:25 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d655ae5d-f257-4220-8a31-788c38362aba tempest-ProjectReaderTests-1850744707 None] Lock "cinder-c1e6036d-1ade-4511-8507-d19039df5eff-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Flow 'volume_create_manager' (a8111b26-175d-4f3b-8277-0cdd12b584de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987dde2c-3da2-480a-80e7-6e77e6cf921b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987dde2c-3da2-480a-80e7-6e77e6cf921b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183495449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d1db28-b7ee-44c8-9902-b75f68e84edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd46d3711874c4bbe41187df4b18313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:06:26Z,use_quota=True,user_id='7117053ef1bf42f182603347dca3640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad56f3df-80d4-4684-a545-ea69afef4e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad56f3df-80d4-4684-a545-ea69afef4e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f741a98-4281-4384-bebf-608d3fde50cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f741a98-4281-4384-bebf-608d3fde50cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d1db28-b7ee-44c8-9902-b75f68e84edd', 'volume_name': 'volume-29d1db28-b7ee-44c8-9902-b75f68e84edd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (237cadaf-27cd-4894-b51e-fca0f4d77df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (237cadaf-27cd-4894-b51e-fca0f4d77df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f395abd2-3cc5-4935-9660-0923abeebdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:26 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Volume 29d1db28-b7ee-44c8-9902-b75f68e84edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d1db28-b7ee-44c8-9902-b75f68e84edd', 'volume_size': 1} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183495449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d1db28-b7ee-44c8-9902-b75f68e84edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd46d3711874c4bbe41187df4b18313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:06:26Z,use_quota=True,user_id='7117053ef1bf42f182603347dca3640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Creating volume 29d1db28-b7ee-44c8-9902-b75f68e84edd {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:06:26 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:06:26 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:26 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd 1073741824 Jul 10 07:06:26 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:26 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd 1073741824" returned: 0 in 0.805s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:27 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd Jul 10 07:06:27 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:27 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd" returned: 0 in 0.648s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:06:27 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f395abd2-3cc5-4935-9660-0923abeebdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d1db28-b7ee-44c8-9902-b75f68e84edd', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d06993c-5a54-4766-aca7-22d40b4cc767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:27 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Volume volume-29d1db28-b7ee-44c8-9902-b75f68e84edd (29d1db28-b7ee-44c8-9902-b75f68e84edd): created successfully Jul 10 07:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d06993c-5a54-4766-aca7-22d40b4cc767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:27 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Flow 'volume_create_manager' (a8111b26-175d-4f3b-8277-0cdd12b584de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:06:27 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-acac485d-8abb-4201-a609-1ade8cf34f68 tempest-ProjectReaderTests-1850744707 None] Created volume successfully. Jul 10 07:06:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:28 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] Creating offline snapshot 12d54881-8954-41e9-b5ad-c1bc0676a11c of volume 29d1db28-b7ee-44c8-9902-b75f68e84edd {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:06:28 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2891a91c-bde2-403c-b3e4-1436f990bec3]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:28 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:28 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd Jul 10 07:06:28 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:29 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd" returned: 0 in 0.742s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:29 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c 1G Jul 10 07:06:29 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:29 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c 1G" returned: 0 in 0.764s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:29 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d1db28-b7ee-44c8-9902-b75f68e84edd -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:29 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d1db28-b7ee-44c8-9902-b75f68e84edd -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c Jul 10 07:06:29 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:30 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29d1db28-b7ee-44c8-9902-b75f68e84edd -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c" returned: 0 in 0.684s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:30 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c is being set with open permissions: ugo+rw Jul 10 07:06:30 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:30 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c Jul 10 07:06:30 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:31 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c" returned: 0 in 0.628s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:31 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.info Jul 10 07:06:31 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:31 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.info" returned: 0 in 0.633s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:31 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.info is being set with open permissions: ugo+rw Jul 10 07:06:31 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:31 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.info Jul 10 07:06:31 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:32 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.info" returned: 0 in 0.622s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:32 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.148s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:32 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d68322c9-4938-4a26-b723-5704cb637dba tempest-ProjectReaderTests-1850744707 None] Create snapshot completed successfully Jul 10 07:06:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-12d54881-8954-41e9-b5ad-c1bc0676a11c-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-12d54881-8954-41e9-b5ad-c1bc0676a11c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-29d1db28-b7ee-44c8-9902-b75f68e84edd" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-29d1db28-b7ee-44c8-9902-b75f68e84edd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-12d54881-8954-41e9-b5ad-c1bc0676a11c" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:33 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-12d54881-8954-41e9-b5ad-c1bc0676a11c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Deleting offline snapshot 12d54881-8954-41e9-b5ad-c1bc0676a11c of volume 29d1db28-b7ee-44c8-9902-b75f68e84edd {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:06:33 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] snapshot_file for this snap is: volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:06:33 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1098ff1f-f539-4502-876f-e2b9398de4f9]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:33 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:33 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c Jul 10 07:06:33 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:34 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c" returned: 0 in 0.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:34 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29d1db28-b7ee-44c8-9902-b75f68e84edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:06:34 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b1896c-4302-489c-9613-b43e2d1bc7c1]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:34 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:34 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd Jul 10 07:06:34 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:35 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:35 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c Jul 10 07:06:35 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:35 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c" returned: 0 in 0.724s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:35 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:35 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c Jul 10 07:06:35 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:36 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd.12d54881-8954-41e9-b5ad-c1bc0676a11c" returned: 0 in 0.640s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-12d54881-8954-41e9-b5ad-c1bc0676a11c" released by "_delete_snapshot" :: held 2.938s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-29d1db28-b7ee-44c8-9902-b75f68e84edd" released by "delete_snapshot" :: held 2.957s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:36 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Created reservations ['e07121a4-0923-4018-bab9-650e70118ac2', '4e9ca7f4-88b8-496f-8eb2-63237a720e94', 'e3ee9445-b0ce-447f-b2a0-5d7d114af08d', 'a8a61436-9763-48e5-9b21-58581a3eb9a4'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:06:36 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Delete snapshot completed successfully. Jul 10 07:06:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-d39f726f-7293-4aeb-865c-b3556316f681 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-12d54881-8954-41e9-b5ad-c1bc0676a11c-delete_snapshot" released by "delete_snapshot" :: held 3.098s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-29d1db28-b7ee-44c8-9902-b75f68e84edd-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-29d1db28-b7ee-44c8-9902-b75f68e84edd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-29d1db28-b7ee-44c8-9902-b75f68e84edd" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:36 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-29d1db28-b7ee-44c8-9902-b75f68e84edd" acquired by "delete_volume" :: waited 0.013s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:36 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3072a2-a6d6-4648-a533-78fc242567ac]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:36 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:36 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd Jul 10 07:06:36 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:37 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd" returned: 0 in 0.786s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:37 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:37 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd Jul 10 07:06:37 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:38 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-29d1db28-b7ee-44c8-9902-b75f68e84edd" returned: 0 in 0.648s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:38 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-29d1db28-b7ee-44c8-9902-b75f68e84edd" released by "delete_volume" :: held 1.487s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:38 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Created reservations ['6e3a62a4-ce78-4a53-95ba-492a76ce9a50', '7c30c0a6-2fde-4028-9d9b-937f539780f9', '5350e852-2081-4bbc-b6f7-ff4999b6de91', '9fadc5e1-714b-4eab-83da-72bad65e184f'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:06:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:06:38 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:06:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:38 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:38 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:06:38 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:39 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.671s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:06:39 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Deleted volume successfully. Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-6b214cc1-3464-4a6e-a4fc-98bf22171d08 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-29d1db28-b7ee-44c8-9902-b75f68e84edd-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Flow 'volume_create_manager' (0e6d0dea-a058-4694-83ac-0686a4346a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f00c40f-ddee-4401-81d1-0e7b7764ba0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f00c40f-ddee-4401-81d1-0e7b7764ba0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027360716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be24f2b4-06fa-457d-8a97-911eaa224726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd46d3711874c4bbe41187df4b18313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:06:39Z,use_quota=True,user_id='7117053ef1bf42f182603347dca3640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf5ec1a-caca-4ad2-b75b-c634e5c6947f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf5ec1a-caca-4ad2-b75b-c634e5c6947f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790cd44a-4c65-4427-b0a6-9ce3065f6de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790cd44a-4c65-4427-b0a6-9ce3065f6de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be24f2b4-06fa-457d-8a97-911eaa224726', 'volume_name': 'volume-be24f2b4-06fa-457d-8a97-911eaa224726', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a497f657-355d-4b12-ade1-5b70e07732eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a497f657-355d-4b12-ade1-5b70e07732eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e55479-013f-434b-a35d-8f9a8fe8be1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:39 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Volume be24f2b4-06fa-457d-8a97-911eaa224726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be24f2b4-06fa-457d-8a97-911eaa224726', 'volume_size': 1} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2027360716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be24f2b4-06fa-457d-8a97-911eaa224726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd46d3711874c4bbe41187df4b18313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:06:39Z,use_quota=True,user_id='7117053ef1bf42f182603347dca3640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Creating volume be24f2b4-06fa-457d-8a97-911eaa224726 {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:06:39 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:06:39 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:39 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 1073741824 Jul 10 07:06:39 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:40 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 1073741824" returned: 0 in 0.776s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:40 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 Jul 10 07:06:40 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:40 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726" returned: 0 in 0.621s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:06:40 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60e55479-013f-434b-a35d-8f9a8fe8be1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be24f2b4-06fa-457d-8a97-911eaa224726', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3c6d52-64ae-4231-87f1-550338adc8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:40 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Volume volume-be24f2b4-06fa-457d-8a97-911eaa224726 (be24f2b4-06fa-457d-8a97-911eaa224726): created successfully Jul 10 07:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3c6d52-64ae-4231-87f1-550338adc8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:40 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Flow 'volume_create_manager' (0e6d0dea-a058-4694-83ac-0686a4346a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:06:40 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-819865b8-5670-453d-a1ec-d6cc7b44bdf8 tempest-ProjectReaderTests-1850744707 None] Created volume successfully. Jul 10 07:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:41 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] Creating offline snapshot fc4eeca5-28d3-4e69-9457-98ee3d74fa99 of volume be24f2b4-06fa-457d-8a97-911eaa224726 {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:06:41 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0c2943-ead5-434a-916b-14178752e387]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:41 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:41 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 Jul 10 07:06:41 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:42 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726" returned: 0 in 0.739s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:42 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:42 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 1G Jul 10 07:06:42 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:43 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 1G" returned: 0 in 0.765s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be24f2b4-06fa-457d-8a97-911eaa224726 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:43 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be24f2b4-06fa-457d-8a97-911eaa224726 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 Jul 10 07:06:43 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:43 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be24f2b4-06fa-457d-8a97-911eaa224726 -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99" returned: 0 in 0.683s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:43 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 is being set with open permissions: ugo+rw Jul 10 07:06:43 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:43 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 Jul 10 07:06:43 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:44 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99" returned: 0 in 0.628s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:44 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:44 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.info Jul 10 07:06:44 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:45 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.info" returned: 0 in 0.642s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:45 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.info is being set with open permissions: ugo+rw Jul 10 07:06:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:45 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.info Jul 10 07:06:45 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:45 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.info" returned: 0 in 0.643s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:45 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.176s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:45 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-cb407092-8b9d-4cd7-b0d6-92fd844af13f tempest-ProjectReaderTests-1850744707 None] Create snapshot completed successfully Jul 10 07:06:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-fc4eeca5-28d3-4e69-9457-98ee3d74fa99-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-fc4eeca5-28d3-4e69-9457-98ee3d74fa99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-be24f2b4-06fa-457d-8a97-911eaa224726" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-be24f2b4-06fa-457d-8a97-911eaa224726" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-fc4eeca5-28d3-4e69-9457-98ee3d74fa99" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:46 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-fc4eeca5-28d3-4e69-9457-98ee3d74fa99" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Deleting offline snapshot fc4eeca5-28d3-4e69-9457-98ee3d74fa99 of volume be24f2b4-06fa-457d-8a97-911eaa224726 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:06:46 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] snapshot_file for this snap is: volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:06:46 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3ada99-0856-4488-b305-32f73f2aa4de]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:46 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:47 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 Jul 10 07:06:47 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:47 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99" returned: 0 in 0.751s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:47 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be24f2b4-06fa-457d-8a97-911eaa224726(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:06:47 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf738f9f-5c57-4766-aa7a-9875f9993921]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:47 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:47 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 Jul 10 07:06:47 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:48 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726" returned: 0 in 0.734s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:48 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:48 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 Jul 10 07:06:48 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:49 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99" returned: 0 in 0.721s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:49 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99 Jul 10 07:06:49 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:49 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:49 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726.fc4eeca5-28d3-4e69-9457-98ee3d74fa99" returned: 0 in 0.635s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-fc4eeca5-28d3-4e69-9457-98ee3d74fa99" released by "_delete_snapshot" :: held 2.924s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-be24f2b4-06fa-457d-8a97-911eaa224726" released by "delete_snapshot" :: held 2.943s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:49 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Created reservations ['0dae4686-be20-4be6-9a41-7c9b11e51e05', 'bcba25b9-c99f-43a4-8f74-6cf85d9f9c6e', 'c2fcf7f0-c9a3-41b2-8c6f-ba1ae82340f2', '7fa1eefc-e6e1-465f-9b37-f6efb0c935fa'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:06:49 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Delete snapshot completed successfully. Jul 10 07:06:49 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-1703dab9-dd70-4e98-9d69-420bacba0373 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-fc4eeca5-28d3-4e69-9457-98ee3d74fa99-delete_snapshot" released by "delete_snapshot" :: held 3.067s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-be24f2b4-06fa-457d-8a97-911eaa224726-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Lock "cinder-be24f2b4-06fa-457d-8a97-911eaa224726-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-be24f2b4-06fa-457d-8a97-911eaa224726" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:06:50 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-be24f2b4-06fa-457d-8a97-911eaa224726" acquired by "delete_volume" :: waited 0.016s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:06:50 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3406c5-bd8b-44c7-9ce5-67c3c5eb467b]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:50 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 Jul 10 07:06:50 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:50 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726" returned: 0 in 0.740s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:50 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:50 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726 Jul 10 07:06:50 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:51 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-be24f2b4-06fa-457d-8a97-911eaa224726" returned: 0 in 0.636s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:51 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-be24f2b4-06fa-457d-8a97-911eaa224726" released by "delete_volume" :: held 1.429s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:51 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Created reservations ['664913e8-e930-4657-a698-bfa039d6908d', '43566431-e68e-4107-903c-874a6b32a38d', '2d081895-146e-4d03-b203-7fb865fcc597', '97f8b6ce-83ed-4248-8cc9-e893abbfe9c0'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:06:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:06:51 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:06:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:51 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:51 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:06:51 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:52 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.638s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:06:52 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Deleted volume successfully. Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-ff0492b1-8bd1-4817-b296-b1887a0c0a6d tempest-ProjectReaderTests-1850744707 None] Lock "cinder-be24f2b4-06fa-457d-8a97-911eaa224726-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86966) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Flow 'volume_create_manager' (654febd1-69b5-45a0-bc4e-324233720a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8560d95-9b7e-494d-8717-57f11a46b414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8560d95-9b7e-494d-8717-57f11a46b414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-252310600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406b8dd4-a339-4426-9dca-4b1d4a41feae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd46d3711874c4bbe41187df4b18313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:06:53Z,use_quota=True,user_id='7117053ef1bf42f182603347dca3640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7efe72-afb3-484e-a079-b06886cea0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f7efe72-afb3-484e-a079-b06886cea0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1072258-91d8-4be8-97b8-a1a380e3dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1072258-91d8-4be8-97b8-a1a380e3dd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406b8dd4-a339-4426-9dca-4b1d4a41feae', 'volume_name': 'volume-406b8dd4-a339-4426-9dca-4b1d4a41feae', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509a9335-2ecd-44f2-9eac-e0ddd988aa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509a9335-2ecd-44f2-9eac-e0ddd988aa35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c291bd-62ef-4177-89bd-7fac4bc8437c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:52 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Volume 406b8dd4-a339-4426-9dca-4b1d4a41feae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406b8dd4-a339-4426-9dca-4b1d4a41feae', 'volume_size': 1} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-252310600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406b8dd4-a339-4426-9dca-4b1d4a41feae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd46d3711874c4bbe41187df4b18313',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:06:53Z,use_quota=True,user_id='7117053ef1bf42f182603347dca3640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ca29c2-9aa4-4b8e-a141-45acc7ba36b5),volume_type_id=51ca29c2-9aa4-4b8e-a141-45acc7ba36b5)}" {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Creating volume 406b8dd4-a339-4426-9dca-4b1d4a41feae {{(pid=86966) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Selected osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 as target Quobyte volume. {{(pid=86966) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:06:52 devstack cinder-volume[86966]: INFO cinder.volume.drivers.remotefs [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] casted to osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5 Jul 10 07:06:52 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae 1073741824 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:52 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae 1073741824 Jul 10 07:06:52 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:53 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae 1073741824" returned: 0 in 0.792s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:53 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:53 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae Jul 10 07:06:53 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:54 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae" returned: 0 in 0.629s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'} {{(pid=86966) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c291bd-62ef-4177-89bd-7fac4bc8437c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406b8dd4-a339-4426-9dca-4b1d4a41feae', 'volume_size': 1}' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9050cf5-7385-48f7-886c-5ea91f5897d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:06:54 devstack cinder-volume[86966]: INFO cinder.volume.flows.manager.create_volume [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Volume volume-406b8dd4-a339-4426-9dca-4b1d4a41feae (406b8dd4-a339-4426-9dca-4b1d4a41feae): created successfully Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9050cf5-7385-48f7-886c-5ea91f5897d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86966) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Flow 'volume_create_manager' (654febd1-69b5-45a0-bc4e-324233720a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86966) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:06:54 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-08d42505-e315-497b-a09b-07bd9095aa2a tempest-ProjectReaderTests-1850744707 None] Created volume successfully. Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] Creating offline snapshot 7609283d-e369-4c90-9933-031604092fcb of volume 406b8dd4-a339-4426-9dca-4b1d4a41feae {{(pid=86966) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca36a22-6b62-495c-bb68-aa86bc072643]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:06:54 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:54 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae Jul 10 07:06:54 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:55 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae" returned: 0 in 0.742s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:55 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb 1G {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:55 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb 1G Jul 10 07:06:55 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:56 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb 1G" returned: 0 in 0.774s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:56 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406b8dd4-a339-4426-9dca-4b1d4a41feae -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:56 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406b8dd4-a339-4426-9dca-4b1d4a41feae -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb Jul 10 07:06:56 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:57 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406b8dd4-a339-4426-9dca-4b1d4a41feae -F qcow2 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb" returned: 0 in 0.673s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:57 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb is being set with open permissions: ugo+rw Jul 10 07:06:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:57 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb Jul 10 07:06:57 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:57 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb" returned: 0 in 0.627s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:57 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:57 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.info Jul 10 07:06:57 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:58 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.info" returned: 0 in 0.630s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:58 devstack cinder-volume[86966]: WARNING cinder.volume.drivers.remotefs [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.info is being set with open permissions: ugo+rw Jul 10 07:06:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.info {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:06:58 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.info Jul 10 07:06:58 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:06:58 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Jul 10 07:06:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.info" returned: 0 in 0.618s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:06:58 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.136s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:06:59 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=69,cinder:UPDATE=86,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:06:59 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-5353ed01-c53d-4bdc-9c98-bb723e5f5b29 tempest-ProjectReaderTests-1850744707 None] Create snapshot completed successfully Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-7609283d-e369-4c90-9933-031604092fcb-delete_snapshot" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-7609283d-e369-4c90-9933-031604092fcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-406b8dd4-a339-4426-9dca-4b1d4a41feae" by "delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-406b8dd4-a339-4426-9dca-4b1d4a41feae" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-7609283d-e369-4c90-9933-031604092fcb" by "_delete_snapshot" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-7609283d-e369-4c90-9933-031604092fcb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Deleting offline snapshot 7609283d-e369-4c90-9933-031604092fcb of volume 406b8dd4-a339-4426-9dca-4b1d4a41feae {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] snapshot_file for this snap is: volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb {{(pid=86966) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe98291-7e94-49fb-90d4-08ce8d6c81aa]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:07:00 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb Jul 10 07:07:00 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:07:00 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb" returned: 0 in 0.740s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.remotefs [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-406b8dd4-a339-4426-9dca-4b1d4a41feae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86966) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3b822e-0a25-4c0a-9531-44e5cd4a18ca]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:07:00 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:07:01 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae Jul 10 07:07:01 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:07:01 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 10 07:07:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae" returned: 0 in 0.735s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:07:01 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:07:01 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb Jul 10 07:07:01 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:07:02 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 10 07:07:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb" returned: 0 in 0.697s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:07:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:07:02 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb Jul 10 07:07:02 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:07:02 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 10 07:07:02 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae.7609283d-e369-4c90-9933-031604092fcb" returned: 0 in 0.615s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:07:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-7609283d-e369-4c90-9933-031604092fcb" released by "_delete_snapshot" :: held 2.876s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:07:02 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-406b8dd4-a339-4426-9dca-4b1d4a41feae" released by "delete_snapshot" :: held 2.897s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:07:03 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Created reservations ['6fc35268-8536-49ce-9198-e9680054dc06', '67d82772-19e5-4fa2-b6c2-0ed3732cd3f4', 'bb15155e-5c32-4296-aec4-bc128272b2e2', '5a21df26-a881-4e20-b85d-0b15aa0249fb'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:07:03 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Delete snapshot completed successfully. Jul 10 07:07:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-a4f67383-e6c8-4673-8505-0f2ef1b9f758 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-7609283d-e369-4c90-9933-031604092fcb-delete_snapshot" released by "delete_snapshot" :: held 3.030s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:07:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-406b8dd4-a339-4426-9dca-4b1d4a41feae-delete_volume" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:07:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-406b8dd4-a339-4426-9dca-4b1d4a41feae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:07:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "cinder-quobyte-406b8dd4-a339-4426-9dca-4b1d4a41feae" by "delete_volume" {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:07:03 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-406b8dd4-a339-4426-9dca-4b1d4a41feae" acquired by "delete_volume" :: waited 0.018s {{(pid=86966) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:07:03 devstack cinder-volume[86966]: DEBUG oslo.privsep.daemon [-] privsep: reply[231eb152-712b-41f6-9e06-a2e1f8d03147]: (4, 'qcow2') {{(pid=88427) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:07:03 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:07:03 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae Jul 10 07:07:03 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:07:04 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 10 07:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae" returned: 0 in 0.754s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:07:04 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae Jul 10 07:07:04 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:07:04 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 10 07:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813/volume-406b8dd4-a339-4426-9dca-4b1d4a41feae" returned: 0 in 0.633s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:07:04 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-quobyte-406b8dd4-a339-4426-9dca-4b1d4a41feae" released by "delete_volume" :: held 1.440s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:07:04 devstack cinder-volume[86966]: DEBUG cinder.quota [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Created reservations ['2c917dad-cb21-4aac-8321-feb3b3ff9d47', '8ac9b689-5915-43fc-b2e2-42e036af29df', 'a2b16ce3-94f2-4ef7-90f1-9fedbfa06ad5', 'f0d33360-2dbc-4bd1-8ad3-581656e5cd33'] {{(pid=86966) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:07:04 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:07:04 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:07:04 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:07:04 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:07:05 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 10 07:07:05 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.633s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:07:05 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:07:05 devstack cinder-volume[86966]: INFO cinder.volume.manager [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Deleted volume successfully. Jul 10 07:07:05 devstack cinder-volume[86966]: DEBUG cinder.coordination [None req-08340a94-0026-492d-aea2-2ba20de83df4 tempest-ProjectReaderTests-1850744707 None] Lock "cinder-406b8dd4-a339-4426-9dca-4b1d4a41feae-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=86966) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:07:11 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5': None} {{(pid=86966) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:07:11 devstack cinder-volume[86966]: DEBUG cinder.volume.drivers.quobyte [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8d56f163-6717-412f-9ecf-d56bfb1ed2a5'] {{(pid=86966) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.lockutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86966) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:07:11 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:07:11 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813 Jul 10 07:07:11 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:07:12 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 10 07:07:12 devstack cinder-volume[86966]: DEBUG oslo_concurrency.processutils [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7ce43a930915929afce2277125d2b813" returned: 0 in 0.624s {{(pid=86966) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:07:12 devstack cinder-volume[86966]: DEBUG cinder.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Notifying Schedulers of capabilities ... {{(pid=86966) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:07:12 devstack cinder-volume[86966]: DEBUG oslo_service.periodic_task [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] Running periodic task VolumeManager._thread_info {{(pid=86966) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:07:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread count: 29 {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:07:12 devstack cinder-volume[86966]: DEBUG cinder.volume.manager [None req-dc21c78c-d230-44d6-ad9b-1713bcf2cdec None None] thread info: [<_MainThread(MainThread, started 135851529191552)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86966) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:07:14 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:INSERT=22,cinder:UPDATE=77,cinder:SELECT=58,cinder:DELETE=7 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:07:15 devstack cinder-volume[86966]: DEBUG dbcounter [-] [86966] Writing DB stats cinder:SELECT=9,cinder:INSERT=5,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=86966) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}